-- Logs begin at Thu 2022-06-23 15:00:25 UTC, end at Thu 2022-06-23 16:17:44 UTC. -- Jun 23 15:52:04.767333 dv-cinder-835384-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 15:52:04.777461 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 15:52:04 2022] *** Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: nodename: dv-cinder-835384-9-iscsi Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: machine: x86_64 Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: clock source: unix Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: pcre jit disabled Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: detected number of CPU cores: 4 Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: current working directory: / Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: detected binary path: /usr/bin/uwsgi-core Jun 23 15:52:04.779528 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: your processes number limit is 47680 Jun 23 15:52:04.780517 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: your memory page size is 4096 bytes Jun 23 15:52:04.780517 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: detected max file descriptor number: 2048 Jun 23 15:52:04.780517 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: lock engine: pthread robust mutexes Jun 23 15:52:04.780517 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: thunder lock: enabled Jun 23 15:52:04.780517 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 15:52:04.780517 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 15:52:04.824817 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: Python main interpreter initialized at 0x564705b3d9c0 Jun 23 15:52:04.824817 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: python threads support enabled Jun 23 15:52:04.824817 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: your server socket listen backlog is limited to 100 connections Jun 23 15:52:04.824817 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: your mercy for graceful operations on workers is 90 seconds Jun 23 15:52:04.825394 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 15:52:04.825394 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: *** Operational MODE: preforking *** Jun 23 15:52:04.825608 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: *** uWSGI is running in multiple interpreter mode *** Jun 23 15:52:04.825608 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: spawned uWSGI master process (pid: 103162) Jun 23 15:52:04.825777 dv-cinder-835384-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 15:52:04.827419 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: spawned uWSGI worker 1 (pid: 103163, cores: 1) Jun 23 15:52:04.827419 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: spawned uWSGI worker 2 (pid: 103164, cores: 1) Jun 23 15:52:04.827419 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 15:52:05.529699 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 15:52:05.578314 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 15:52:06.706806 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:52:06.706806 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: from cryptography.utils import int_from_bytes Jun 23 15:52:06.707518 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:52:06.707518 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: from cryptography.utils import int_from_bytes Jun 23 15:52:06.752089 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:52:06.752089 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: from cryptography.utils import int_from_bytes Jun 23 15:52:06.752675 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:52:06.752675 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: from cryptography.utils import int_from_bytes Jun 23 15:52:09.407960 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 15:52:09.408923 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 15:52:09.408923 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 15:52:09.409227 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 15:52:09.409387 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 15:52:09.409781 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.410115 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.410439 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.410787 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.411127 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.411443 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.411773 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.412100 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.412442 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.412708 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.413028 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.413360 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-9-iscsi {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.413696 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.414015 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.414332 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.414652 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.415000 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.415328 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.416179 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.416709 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.417196 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.417477 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.417797 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.418199 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.418474 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.418814 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.419141 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.419455 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.419791 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.420105 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.420518 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-9-iscsi {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.420840 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.421159 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.421479 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.421908 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.422237 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.422535 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.422891 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.423230 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.423544 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.423875 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.424198 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.424632 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.424844 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.425172 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.425512 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.425848 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.426179 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.426492 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.426825 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.427083 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.427397 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.427724 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.428051 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.428380 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.428637 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.428894 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.429216 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 15:52:09.429904 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.429904 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.430175 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 15:52:09.430313 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.430313 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.430594 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.430881 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 15:52:09.431058 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.431058 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.431994 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 15:52:09.432231 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.432376 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 15:52:09.432627 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.432627 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.433004 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.433156 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.433327 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.433487 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.433799 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.433799 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.434083 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.434262 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.434476 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.434643 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.434946 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.435086 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.435219 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.435383 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.435513 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.435788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.435963 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.436096 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.436213 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.436328 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.436448 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.436700 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.436847 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.437006 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.437135 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.437278 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.437400 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-9-iscsi {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.437603 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.437846 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.438010 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.438247 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.438422 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.438571 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.438795 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.438964 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.439112 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.439282 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.439503 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.439709 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.439857 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.440011 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.440293 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.440470 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.440623 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.440830 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.440999 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.441194 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.441505 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.441671 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.441845 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.442112 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.442269 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.442430 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.442657 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.442918 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.443074 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.443231 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.443392 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.443628 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.443795 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.443941 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.444264 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.444423 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.444635 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.444838 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.445058 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.445206 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.445357 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.445520 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.445764 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.445923 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.446081 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.446370 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.446520 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.446718 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.446954 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.447135 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.447353 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.448053 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-9-iscsi {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.448207 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.448207 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.448593 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.448747 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.448747 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.449022 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.449162 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.449162 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.449442 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.449580 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.449782 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.449974 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.450135 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.450349 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.450519 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.450674 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.450976 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.451125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.451267 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.451563 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.451779 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.451962 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.452170 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.452323 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.452474 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.452671 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.452821 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.453152 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.453310 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.453464 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.453693 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.453850 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.454022 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.454290 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.454489 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.454843 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.455219 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.455370 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.455751 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.455911 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.456054 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.456297 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.456546 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.456732 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.456869 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.457061 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.457343 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.457495 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.457813 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.458020 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.458236 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.458646 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.458876 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.459829 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.462213 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.462409 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.462409 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.462756 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.462921 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.463241 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.463241 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.463504 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.463648 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.463805 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.463960 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.463960 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.464245 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.464390 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.464546 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.464713 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.464713 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.465052 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.465210 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.465403 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.465594 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.465765 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.465765 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.466005 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.466138 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.466265 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.466411 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.466538 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.466863 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.467028 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.467028 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.467317 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.467457 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.467583 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.467704 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.467704 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.468118 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.468244 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.468244 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.468487 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.468624 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.468768 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.468907 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.469088 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.469324 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.469477 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.469721 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.470023 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.470363 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.470363 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.470880 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.471009 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.471359 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.471504 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.471504 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.471778 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.471922 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.472064 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.472204 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.472346 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.472636 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.472808 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.472968 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.473189 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.473349 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.473564 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.473735 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.473933 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.474183 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.474331 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.474535 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.474809 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.474962 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.475165 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.475510 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.475818 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.475977 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.476246 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.476395 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.476567 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.476891 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.477040 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.477214 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.477377 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.477521 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.477820 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.478501 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.478798 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.478943 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.479101 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.479407 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.479572 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.479881 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.480034 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.480357 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.480530 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.480973 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.481155 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.481369 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.481694 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.481859 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.482269 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.482435 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.482788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.482962 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.486949 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.487177 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.487177 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.487477 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.487625 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.487625 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.487903 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.488034 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.488034 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.488297 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.488424 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.488565 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.488693 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.488693 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.489150 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.489301 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.489301 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.489743 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.489882 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.489882 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.490311 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.490482 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.490482 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.490824 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.490970 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.491156 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.491313 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.491313 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.491603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.491762 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.491762 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.492041 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.492204 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.492204 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.492477 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.492621 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.492621 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.492895 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.493040 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.493181 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.493320 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.493320 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.493554 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.494257 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.494257 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.494514 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.494643 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.494643 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.495144 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.495289 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.495417 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.495572 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.495572 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.495915 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.496126 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.496126 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.496408 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.496552 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.496552 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.496839 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.496995 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.497143 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.497286 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.497286 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.497561 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.497703 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.497867 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.497867 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.498153 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.498295 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.498438 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.498739 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.498894 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.499204 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.499493 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.499675 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.499836 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.500159 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.500298 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.500490 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.500677 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.500812 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.501133 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.501285 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.501502 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.501643 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.501833 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.502122 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.502272 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.502480 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.502665 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.504131 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.504131 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.504398 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.504543 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.504543 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.504822 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.505007 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.505163 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.505307 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.505307 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.505552 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 15:52:09.505681 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.505681 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.505909 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.506056 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.506195 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.506590 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.506913 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.507164 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.507316 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.507657 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.507827 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.508158 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.508370 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.508646 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.508783 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.509080 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.509214 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.509537 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.509855 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.509983 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.510128 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.510265 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.510395 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.510739 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.510880 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.511053 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.511273 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.511440 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.511676 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.511822 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.511995 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.512288 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.512441 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.512628 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.512926 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.513073 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.513283 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.513427 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.513597 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.513871 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.514002 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.514184 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.514434 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.514571 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.516960 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.517121 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.517281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.517281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.517560 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.517704 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.517704 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.517962 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.518090 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.518090 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.518337 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.518462 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.518462 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.518771 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.518917 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.518917 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.519177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.519322 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.519485 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.519629 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.519629 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.520045 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.520192 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.520192 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.520713 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.520842 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.520842 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.521066 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.521194 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.521194 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.521450 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.521589 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.521718 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.521865 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.521994 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.522140 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.522269 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.522709 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.522888 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.523222 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.523373 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.523832 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.523990 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.524250 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.524403 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.524752 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.524956 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.525337 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.525516 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.525781 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.525932 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.526309 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.526634 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.526869 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.527021 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.527214 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.527475 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.527689 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.528051 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.528208 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.528657 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.528830 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.529146 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.529300 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.529634 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.529801 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.530085 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.530236 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.530539 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.530803 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.531017 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.531169 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.531496 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.531650 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.531954 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.532126 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.532423 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.532591 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.532863 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.533011 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.533303 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.533452 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.533748 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.533931 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.534227 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.534475 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.534665 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.535029 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.535200 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.535541 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.535698 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.536010 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.536163 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.536482 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.536658 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.536963 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.537276 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.537540 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.537798 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.538026 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.538189 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.538485 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.538646 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.539020 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.539172 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.539487 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.539635 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.539953 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.540104 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.540993 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.541151 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.541513 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.541679 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.541955 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.542121 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.542399 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.542548 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.542909 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.543060 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.543348 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.543536 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.543842 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.544017 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.544332 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.544494 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.544822 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.544970 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.545278 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.545441 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.545754 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.545903 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.546189 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.546366 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.546627 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.546901 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.547117 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.547419 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.547616 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.547927 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.548083 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.548424 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.548578 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.548913 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.549067 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.549367 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.549537 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.549804 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.549955 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.550261 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.550420 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.550737 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.550971 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.551221 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.551418 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.551715 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.551905 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.552283 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.552494 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.552689 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.552945 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.553136 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.553442 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.553659 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.553988 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.554178 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.554487 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.554681 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.555031 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.555261 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.555548 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.555737 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.556077 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.556831 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.557149 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.557389 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.557670 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.557958 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.558182 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.558533 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.558778 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.559143 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.559343 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.559676 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.559866 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.560213 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.560415 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.560753 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.560946 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.561267 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.561423 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.561751 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.561929 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.562201 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.562356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.562672 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.562876 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.563165 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.563332 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.563610 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.563762 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.564063 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.564212 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.564506 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.564668 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.564947 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.565098 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.565449 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.565600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.565898 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.566061 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.566402 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.566564 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.566894 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.567047 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.567333 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.567546 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.567797 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.568048 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.568265 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.568535 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.568799 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.569060 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.569212 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.569528 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.569680 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.569970 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.570133 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.570406 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.570568 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.570901 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.571113 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.571427 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.571596 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.572094 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.572325 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.572578 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.572925 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.573083 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.573494 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.573650 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.574037 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.574191 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.574556 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.574766 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.578722 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.578987 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.579681 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.579807 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.579807 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.580039 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.580163 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.580268 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.580396 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.580497 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.580624 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.580624 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.580868 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.580982 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.580982 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.581185 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.581301 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.581301 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.581301 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.581301 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.581301 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.581301 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.581301 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.581847 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.582164 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.582316 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.582615 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.582884 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.583114 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.583422 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.583585 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.583911 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.584065 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.584395 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.584546 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.584835 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.584989 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.585275 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.585425 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.585768 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.585931 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.586226 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.586376 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.586664 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.586878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.587157 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.587335 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.587666 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.587872 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.588113 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.588379 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.588541 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.588863 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.589016 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.589338 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.589490 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.589796 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.589957 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.590237 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.590389 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.590670 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.590855 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.591163 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.591315 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.591603 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.591759 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.592174 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.592329 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.592573 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.592782 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.593023 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.593280 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.593432 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.593778 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.593932 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.594268 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.594434 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.594812 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.594986 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.595299 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.595454 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.595746 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.595951 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.596226 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.596377 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.596679 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.596853 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.597138 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.597338 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.597602 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.597828 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.598047 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.598367 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.598631 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.598904 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.599092 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.599402 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.599569 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.599890 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.600049 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.600355 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.600505 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.600800 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.600953 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.601248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.601397 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.601708 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.601859 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.602358 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.602524 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.602726 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.602875 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.603725 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.603878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.604184 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.604362 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.604631 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.604861 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.605079 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.605358 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.605660 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.605849 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.606137 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.606346 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.606605 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.606909 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.607194 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.607398 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.607646 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.607888 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.608089 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.608387 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.608540 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.608856 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.609007 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.609328 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.609492 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.609812 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.610023 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.610291 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.610653 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.610876 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.611171 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.611322 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.611633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.611784 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.612090 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.612243 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.612617 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.612786 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.613091 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.613252 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.613556 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.613708 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.614022 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.614171 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.614483 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.614796 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.614973 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.615259 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.615597 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.615779 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.616054 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.616201 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.616567 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.616734 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.617038 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.617213 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.617503 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.617656 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.617951 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.618103 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.618404 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.618556 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.619453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.619604 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.619899 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.620053 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.620343 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.620521 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.620799 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.621010 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.621243 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.621504 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.621671 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.621997 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.622164 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.622474 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.622868 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.623075 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.623255 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.623536 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.623700 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.623999 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.624161 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.624440 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.624591 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.624912 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.625075 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.625361 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.625510 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.625822 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.625980 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.626275 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.626479 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.626810 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.626990 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.627280 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.627519 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.627725 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.628024 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.628176 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.628524 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.628693 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.628985 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.629135 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.629456 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.629606 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.629903 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.630052 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.630369 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.630520 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.630876 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.631030 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.631340 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.631512 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.631787 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.631948 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.632257 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.632408 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.632766 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.632996 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.633267 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.633416 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.633726 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.633876 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.634198 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.634380 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.634718 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.634888 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.635228 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.635397 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.635710 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.635860 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.636147 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.636297 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.636589 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.636753 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.637081 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.637234 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.637535 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.637688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.637976 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.638143 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.638422 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.638576 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.638893 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.639061 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.639362 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.639527 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.639814 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.639962 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.640277 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.640428 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.640726 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.640888 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.641169 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.641318 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.641613 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.641763 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.642055 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.642239 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.642546 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.642776 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.643074 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.643269 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.643600 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.643771 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.644056 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.644205 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.644514 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.644663 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.644978 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.645126 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.645674 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.645836 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.646144 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.646307 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.646589 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.646790 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.647130 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.647281 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.647593 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.647771 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.648050 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.648197 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.648506 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.648656 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.648969 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.649140 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.649422 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.649570 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.650399 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.650562 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.650890 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.651061 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.651339 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.651488 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.651787 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.652026 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.652436 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.652599 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.652909 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.653136 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.653425 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.653596 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.653907 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.654062 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.654374 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.654525 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.654862 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.655035 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.655318 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.655489 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.655829 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.655983 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.656303 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.656457 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.656771 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.656907 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.657279 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.657656 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.657812 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.658045 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.658356 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.658508 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.658871 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.659025 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.659352 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.659516 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.659927 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.660107 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.660376 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.660532 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.660852 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.661007 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.661327 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.661495 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.661799 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.661953 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.662267 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.662417 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.662920 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.663106 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.663475 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.663617 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.663893 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.664102 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.664414 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.664660 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.664926 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.665245 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.665493 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.666231 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.666604 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.666796 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.667111 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.667277 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.667602 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.667752 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.668088 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.668244 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.668556 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.668710 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.669021 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.669185 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.669488 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.669643 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.669959 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.670124 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.670418 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.670638 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.670910 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.671062 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.671363 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.671561 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.671826 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.671992 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.672359 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.672577 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.672847 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.673002 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.673348 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.673569 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.673857 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.674014 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.674335 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.674489 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.674894 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.675048 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.675365 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.675520 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.675856 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.676008 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.676292 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.676444 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.676726 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.676888 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.677169 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.677321 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.677668 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.677875 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.678146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.678299 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.678603 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.678783 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.679089 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.679352 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.679508 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.679827 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.679980 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.680328 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.680497 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.680803 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.681139 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.681304 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.681636 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.681809 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.682094 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.682262 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.682561 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.682741 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.683061 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.683226 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.683513 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.683803 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.684025 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.684287 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.684532 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.684780 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.685023 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.685263 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.685472 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.685745 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.685927 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.686228 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.686391 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.686751 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.686905 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.687229 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.687403 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.687683 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.687832 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.688153 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.688306 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.688618 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.688784 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.689086 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.689237 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.689532 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.689683 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.689999 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.690151 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.690452 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.690713 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.690946 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.691199 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.691370 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.691674 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.691828 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.692185 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.692333 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.692642 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.692804 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.693081 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.693245 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.693526 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.693707 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.694011 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.694203 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.694507 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.694716 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.695032 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.695195 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.695499 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.695665 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.695942 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.696133 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.696471 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.696621 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.697028 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.697183 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.697508 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.697662 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.697981 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.698184 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.698480 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.698634 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.698989 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.699147 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.699471 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.699626 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.699955 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.700115 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.700425 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.700578 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.700882 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.701100 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.701379 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.701611 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.701964 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.702115 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.702451 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.702616 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.703028 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.703275 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.703515 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.703740 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.704000 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.704217 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.704515 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.704672 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.704982 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.705186 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.705473 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.705651 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.705970 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.706139 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.706416 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.706566 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.706927 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.707100 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.707376 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.707533 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.707818 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.707981 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.708290 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.708452 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.708765 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.708917 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.709214 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.709376 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.709655 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.709808 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.710133 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.710284 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.710587 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.710794 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.711059 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.711209 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.711509 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.711699 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.711957 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.712190 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.712956 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.713237 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.713390 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.713713 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.713866 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.714185 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.714391 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.714713 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.714869 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.715178 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.715399 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.715721 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.715875 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.716186 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.716341 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.716669 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.716831 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.717117 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.717269 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.717606 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.717758 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.718057 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.718224 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.718568 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.718820 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.719069 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.719240 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.719520 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.719787 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.719932 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.720136 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.720528 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.720693 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.720974 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.721144 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.721430 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.721579 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.721898 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.722048 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.722369 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.722532 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.722860 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.723014 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.723342 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.723520 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.723833 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.723985 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.724289 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.724452 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.724751 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.724889 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.725206 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.725473 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.725752 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.726043 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.726254 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.726531 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.726840 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.727153 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.727338 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.727609 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.727824 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.728642 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.728899 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.729205 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.729367 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.729658 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.729878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.730126 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.730364 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.730578 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.730914 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.731070 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.731397 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.731570 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.731863 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.732023 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.732330 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.732483 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.732769 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.732929 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.733230 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.733380 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.733668 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.733817 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.734115 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.734316 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.734554 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.734869 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.735129 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.735382 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.735629 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.735900 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.736140 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.736391 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.736574 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.736881 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.737049 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.737362 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.737515 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.737844 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.737998 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.738292 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.738442 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.738765 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.738968 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.739256 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.739649 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.739824 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.740130 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.740294 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.740612 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.740779 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.741068 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.741232 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.741536 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.741689 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.741989 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.742140 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.742452 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.742620 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.742931 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.743085 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.743398 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.743549 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.743883 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.744038 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.744333 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.744486 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.744844 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.745046 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.745353 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.745519 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.745796 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.745946 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.746276 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.746447 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.746746 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.746923 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.747204 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.747438 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.747648 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.747944 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.748121 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.748431 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.748586 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.748936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.749143 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.749443 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.749599 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.749915 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.750078 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.750376 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.750542 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.750862 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.751030 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.751337 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.751502 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.751790 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.751963 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.752271 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.752435 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.752723 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.752874 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.753183 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.753350 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.753641 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.753793 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.754090 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.754240 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.754543 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.754807 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.755105 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.755342 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.755623 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.755777 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.756114 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.756335 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.756615 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.756766 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.757060 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.757224 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.757524 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.757675 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.757987 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.758139 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.758533 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.758874 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.759052 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.759398 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.759553 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.759892 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.760046 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.760378 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.760530 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.760834 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.760999 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.761287 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.761439 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.761660 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103163) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 15:52:09.761873 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.762305 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.762774 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.763156 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.763567 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.763984 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.764387 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.764802 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.765207 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.765634 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.766050 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.766505 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.767210 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.767658 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.768072 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.768495 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.768932 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.769344 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.769749 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.770169 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.770872 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.771284 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.771706 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.772114 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.772515 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.772917 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.773325 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.773728 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.774135 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.774541 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.775560 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.776007 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.776417 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.776822 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.777232 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.777643 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.778053 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.778458 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.778899 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.779313 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.779723 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.780130 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.780534 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.780940 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.781348 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.781755 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.782158 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.782606 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.783058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.783468 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.783876 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.784301 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.784714 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.785136 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.785550 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.785984 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.786449 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.786916 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.787592 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.788027 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.788454 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.788892 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.789323 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.789727 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.790127 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.790590 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.791535 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.791941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.792358 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.792765 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.793177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.793581 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.793985 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.794396 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.794845 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.795282 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.795687 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.796100 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.796528 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.796942 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.797354 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.797797 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.798214 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.798625 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.799067 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.799486 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.799900 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.800306 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.800711 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.801115 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.801525 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.801955 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.802363 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.802809 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.803347 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.803759 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.804179 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.804593 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.805002 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.805426 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.805847 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.806293 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.806823 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.807237 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.807664 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.808103 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.808530 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.808949 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.809361 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.809763 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.810164 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.810604 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.811059 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.811472 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.811870 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.812277 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.812681 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.813082 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.813484 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.813893 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.814293 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.814716 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.815116 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.815517 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.815928 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.816336 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.816763 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.817166 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.817596 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.818009 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.818411 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.818860 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.819260 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.819660 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.820091 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.820519 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.820940 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.821360 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.821803 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.822392 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.822839 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.823270 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.823693 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.824115 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.824520 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.824948 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.825377 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.825830 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.826142 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.826556 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.826844 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.827498 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.827671 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.827926 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.828253 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.828584 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.828903 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.829232 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.829551 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.829867 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.830201 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.830516 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.830863 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.831188 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.831502 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.831829 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.832134 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.832453 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.832782 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.833113 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.833425 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.833753 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.834082 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.834436 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.834774 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.835122 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.835464 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.835769 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.836080 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.836387 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 15:52:09.836634 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103164) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 15:52:09.843746 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO dbcounter [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Registered counter for database nova_api Jun 23 15:52:09.960572 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_db.sqlalchemy.engines [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 15:52:09.967549 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writer thread running {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 15:52:09.996909 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO dbcounter [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Registered counter for database nova_api Jun 23 15:52:10.016680 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 15:52:10.023543 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG dbcounter [-] [103164] Writer thread running {{(pid=103164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 15:52:10.027835 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.context [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b684caf-4cee-45d0-96c0-d4ffe1988b04(cell1) {{(pid=103163) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 15:52:10.031844 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:52:10.033463 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:52:10.034265 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:52:10.036399 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:52:10.038374 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO dbcounter [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Registered counter for database nova_cell0 Jun 23 15:52:10.042935 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO dbcounter [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Registered counter for database nova_cell1 Jun 23 15:52:10.050352 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_db.sqlalchemy.engines [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 15:52:10.052064 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_db.sqlalchemy.engines [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 15:52:10.057780 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writer thread running {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 15:52:10.063531 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writer thread running {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 15:52:10.083070 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.context [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b684caf-4cee-45d0-96c0-d4ffe1988b04(cell1) {{(pid=103164) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 15:52:10.087153 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG oslo_concurrency.lockutils [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:52:10.088767 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG oslo_concurrency.lockutils [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:52:10.089653 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG oslo_concurrency.lockutils [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:52:10.091825 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG oslo_concurrency.lockutils [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103164) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:52:10.093946 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO dbcounter [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Registered counter for database nova_cell0 Jun 23 15:52:10.098570 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO dbcounter [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Registered counter for database nova_cell1 Jun 23 15:52:10.107685 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 15:52:10.112869 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG dbcounter [-] [103164] Writer thread running {{(pid=103164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 15:52:10.119988 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 15:52:10.226384 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO dbcounter [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Registered counter for database nova_cell0 Jun 23 15:52:10.235981 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_db.sqlalchemy.engines [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103163) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 15:52:10.242024 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writer thread running {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 15:52:10.275991 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG dbcounter [-] [103164] Writer thread running {{(pid=103164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 15:52:10.285883 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO dbcounter [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Registered counter for database nova_cell0 Jun 23 15:52:10.296167 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG oslo_db.sqlalchemy.engines [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103164) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 15:52:10.301123 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG dbcounter [-] [103164] Writer thread running {{(pid=103164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 15:52:10.597422 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: WARNING keystonemiddleware.auth_token [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 15:52:10.605527 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: WARNING keystonemiddleware.auth_token [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 15:52:10.639406 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: WARNING keystonemiddleware.auth_token [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 15:52:10.647179 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: WARNING keystonemiddleware.auth_token [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 15:52:10.963310 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: WARNING keystonemiddleware.auth_token [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 15:52:10.969766 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: WARNING keystonemiddleware.auth_token [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 15:52:10.975388 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564705b3d9c0 pid: 103163 (default app) Jun 23 15:52:10.977556 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:52:10.978882 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001867 Jun 23 15:52:10.979410 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Thu Jun 23 15:52:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:52:11.003570 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: WARNING keystonemiddleware.auth_token [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 15:52:11.010188 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: WARNING keystonemiddleware.auth_token [None req-8ce915c1-e865-4c1e-809f-02db98964b3f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 15:52:11.015592 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564705b3d9c0 pid: 103164 (default app) Jun 23 15:53:37.179751 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:37.180766 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 23 15:53:37.181161 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 2/2] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:53:37.197428 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG dbcounter [-] [103164] Writing DB stats nova_api:SELECT=3 {{(pid=103164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:37.199307 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG dbcounter [-] [103164] Writing DB stats nova_cell0:SELECT=3 {{(pid=103164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:37.200241 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG dbcounter [-] [103164] Writing DB stats nova_cell1:SELECT=3 {{(pid=103164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:37.201506 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG dbcounter [-] [103164] Writing DB stats nova_cell0:SELECT=3 {{(pid=103164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:37.675537 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-de706530-b7ae-4f43-ac56-a5a4a336557d admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:37.708246 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-de706530-b7ae-4f43-ac56-a5a4a336557d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.517835 Jun 23 15:53:37.708972 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 1/3] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jun 23 15:53:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:53:39.935732 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:39.936756 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-4a085de5-2025-4ee2-9273-d1c18ba72b3e None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 23 15:53:39.937401 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 3/4] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:53:40.015994 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-d3fabb79-e745-4e8f-b0c5-60787cde2bc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "swap": 0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "id": "c1"}} {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:40.035873 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:53:40.035873 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: warnings.warn(msg) Jun 23 15:53:40.070531 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-d3fabb79-e745-4e8f-b0c5-60787cde2bc6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.126568 Jun 23 15:53:40.071748 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 2/5] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 23 15:53:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 15:53:40.364920 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-dd4ccef1-81fe-4ff3-9ace-8dbcb5211df9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:40.368061 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:53:40.368061 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: warnings.warn(msg) Jun 23 15:53:40.370998 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writing DB stats nova_api:SELECT=3 {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:40.372062 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writing DB stats nova_cell0:SELECT=3 {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:40.372988 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writing DB stats nova_cell1:SELECT=3 {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:40.374666 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:53:40.451512 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-dd4ccef1-81fe-4ff3-9ace-8dbcb5211df9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.365537 Jun 23 15:53:40.452373 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 4/6] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jun 23 15:53:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:53:42.688601 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-d3fabb79-e745-4e8f-b0c5-60787cde2bc6 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:42.689621 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-d3fabb79-e745-4e8f-b0c5-60787cde2bc6 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 23 15:53:42.690178 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 3/7] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:53:42.797380 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-61d7f289-2321-4a28-acb8-b719362da672 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "ram": 512, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:42.815047 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:53:42.815047 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: warnings.warn(msg) Jun 23 15:53:42.835793 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-61d7f289-2321-4a28-acb8-b719362da672 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139658 Jun 23 15:53:42.836358 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 5/8] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 23 15:53:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 15:53:42.857986 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-7808f74a-f641-4863-9dde-17cca7f36401 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:42.859630 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:53:42.859630 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: warnings.warn(msg) Jun 23 15:53:42.891528 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-7808f74a-f641-4863-9dde-17cca7f36401 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037601 Jun 23 15:53:42.892304 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 4/9] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jun 23 15:53:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 15:53:45.036025 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-61d7f289-2321-4a28-acb8-b719362da672 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:45.037047 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-61d7f289-2321-4a28-acb8-b719362da672 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 23 15:53:45.037756 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 6/10] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 15:53:45.102562 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-ae338d02-8c74-4c46-9944-6292184fd78e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:45.122841 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-ae338d02-8c74-4c46-9944-6292184fd78e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078071 Jun 23 15:53:45.129679 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 5/11] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 23 15:53:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:53:45.141435 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-47e8a2c5-044d-4fbc-9113-f43bf3334755 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:45.180419 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-47e8a2c5-044d-4fbc-9113-f43bf3334755 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048325 Jun 23 15:53:45.183381 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 7/12] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jun 23 15:53:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:53:47.532178 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-ae338d02-8c74-4c46-9944-6292184fd78e admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:47.534333 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-ae338d02-8c74-4c46-9944-6292184fd78e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002663 Jun 23 15:53:47.539097 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 6/13] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:53:47 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:53:47.630194 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-11d62122-ea1b-44a5-82d5-52f4f3b2ea77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048, "id": "d3", "name": "ds2G", "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:47.646790 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-11d62122-ea1b-44a5-82d5-52f4f3b2ea77 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.101068 Jun 23 15:53:47.647365 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 8/14] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 23 15:53:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:53:47.660365 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-58285a87-1c3a-4171-913a-86aa3d73aa34 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:47.688046 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-58285a87-1c3a-4171-913a-86aa3d73aa34 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031683 Jun 23 15:53:47.688632 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 7/15] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jun 23 15:53:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:53:49.852152 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-11d62122-ea1b-44a5-82d5-52f4f3b2ea77 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:49.853535 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-11d62122-ea1b-44a5-82d5-52f4f3b2ea77 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001810 Jun 23 15:53:49.854126 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 9/16] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:53:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:53:49.941987 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-2b78e3a5-4907-4578-b363-2fb210e2c7af admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "disk": 20}} {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:49.973399 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-2b78e3a5-4907-4578-b363-2fb210e2c7af admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.102323 Jun 23 15:53:49.974067 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 8/17] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 23 15:53:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:53:49.986898 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-5f644686-f05a-4e49-aed2-992302c1fecc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:50.018825 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-5f644686-f05a-4e49-aed2-992302c1fecc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035720 Jun 23 15:53:50.019482 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 10/18] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jun 23 15:53:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:53:52.165280 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-2b78e3a5-4907-4578-b363-2fb210e2c7af admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:52.166305 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-2b78e3a5-4907-4578-b363-2fb210e2c7af admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 23 15:53:52.167013 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 9/19] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:53:52.228587 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-6bcdcba4-3fa2-4f96-b800-b54729543238 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:52.253297 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-6bcdcba4-3fa2-4f96-b800-b54729543238 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080290 Jun 23 15:53:52.254045 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jun 23 15:53:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 15:53:54.430075 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-2b78e3a5-4907-4578-b363-2fb210e2c7af admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:54.431102 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-2b78e3a5-4907-4578-b363-2fb210e2c7af admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jun 23 15:53:54.436888 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 10/21] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:53:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:53:54.501109 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-b8b370ce-403a-4499-8615-fe93dd422b22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:54.526213 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-b8b370ce-403a-4499-8615-fe93dd422b22 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.087223 Jun 23 15:53:54.527065 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 12/22] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 23 15:53:54 2022] POST /compute/v2.1/flavors => generated 402 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:53:54.539029 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-986caea5-8841-4cad-a715-d1edb826fc15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:54.585485 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-986caea5-8841-4cad-a715-d1edb826fc15 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047602 Jun 23 15:53:54.585485 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 11/23] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jun 23 15:53:54 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:53:56.813130 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-b8b370ce-403a-4499-8615-fe93dd422b22 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:56.814155 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-b8b370ce-403a-4499-8615-fe93dd422b22 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 23 15:53:56.814562 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 13/24] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:53:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:53:56.874057 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-a23d1a0c-463f-4a49-be3b-fea82fe9f5e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "name": "m1.small", "swap": 0}} {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:56.892739 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-a23d1a0c-463f-4a49-be3b-fea82fe9f5e2 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072198 Jun 23 15:53:56.893507 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 12/25] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 23 15:53:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:53:56.906115 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-f5e2b105-2407-4ccd-833c-bb503dc6621c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:56.935079 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-f5e2b105-2407-4ccd-833c-bb503dc6621c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032517 Jun 23 15:53:56.935826 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 14/26] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jun 23 15:53:56 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:53:59.728723 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-a23d1a0c-463f-4a49-be3b-fea82fe9f5e2 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:53:59.729761 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-a23d1a0c-463f-4a49-be3b-fea82fe9f5e2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 23 15:53:59.730182 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 13/27] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:53:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:53:59.793827 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-03d7748b-7253-460c-bbe1-cac2081674fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3"}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:59.816335 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-03d7748b-7253-460c-bbe1-cac2081674fc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079690 Jun 23 15:53:59.816895 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 15/28] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 23 15:53:59 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:53:59.836256 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-377c3614-af57-4fe1-a073-b506b25fa34c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:53:59.873672 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-377c3614-af57-4fe1-a073-b506b25fa34c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042709 Jun 23 15:53:59.874741 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 14/29] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jun 23 15:53:59 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:54:02.120751 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-03d7748b-7253-460c-bbe1-cac2081674fc admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:02.121773 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-03d7748b-7253-460c-bbe1-cac2081674fc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 23 15:54:02.122178 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 16/30] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:54:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:02.193351 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-3841079c-6273-4e2d-a11b-cb2cda27b0e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 80, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:54:02.212615 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-3841079c-6273-4e2d-a11b-cb2cda27b0e0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084291 Jun 23 15:54:02.213171 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 15/31] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 23 15:54:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:54:02.225416 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-79d8a2de-cc40-4c69-bd68-eca1e7347466 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:54:02.254749 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-79d8a2de-cc40-4c69-bd68-eca1e7347466 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033060 Jun 23 15:54:02.255730 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 17/32] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jun 23 15:54:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 15:54:04.395655 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-3841079c-6273-4e2d-a11b-cb2cda27b0e0 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:04.397696 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-3841079c-6273-4e2d-a11b-cb2cda27b0e0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002526 Jun 23 15:54:04.398101 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 16/33] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:54:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:04.470925 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-0106e4c0-22ad-44ef-834b-a86ee8c40b98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "ram": 16384, "id": "5", "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:54:04.495660 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-0106e4c0-22ad-44ef-834b-a86ee8c40b98 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.091367 Jun 23 15:54:04.503322 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 18/34] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jun 23 15:54:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:54:04.510579 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-055ac1fe-8665-4da3-8f3f-049f53463f1f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:54:04.541812 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-055ac1fe-8665-4da3-8f3f-049f53463f1f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035905 Jun 23 15:54:04.542412 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 17/35] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jun 23 15:54:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:54:29.925326 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-0106e4c0-22ad-44ef-834b-a86ee8c40b98 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:29.926336 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-0106e4c0-22ad-44ef-834b-a86ee8c40b98 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jun 23 15:54:29.926756 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 19/36] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:54:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:29.939209 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG dbcounter [-] [103164] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:54:29.989569 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-dcdb626c-5ffa-4cf6-9ef6-0f2805440dce admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:30.007900 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-dcdb626c-5ffa-4cf6-9ef6-0f2805440dce admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073315 Jun 23 15:54:30.008457 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 18/37] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jun 23 15:54:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 15:54:30.970667 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-0106e4c0-22ad-44ef-834b-a86ee8c40b98 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:30.971709 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-0106e4c0-22ad-44ef-834b-a86ee8c40b98 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jun 23 15:54:30.972102 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 20/38] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:54:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:31.174775 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-12f03c35-294d-4ebe-b53e-729a9b65e1a0 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:31.181144 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.wsgi [None req-12f03c35-294d-4ebe-b53e-729a9b65e1a0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-12f03c35-294d-4ebe-b53e-729a9b65e1a0 admin admin] Request method failure captured: Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Accept: application/json Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Accept-Encoding: gzip, deflate Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Connection: keep-alive Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Content-Length: 0 Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Host: 10.222.0.46 Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Openstack-Api-Version: compute 2.90 Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Openstack-System-Scope: None Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: User-Agent: python-novaclient Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Auth-Token: gAAAAABitIy2_VFSoCDOGleE9__2A06n9vQBQDbv1fTwH0S7L8oDeZ8rmRGnZ1q6pKEw6Lh1dTkMQSbkmBQuyCzoovEUzNUV84tsaWadVfGgKsGiCxk5-NED-JRmzF5gKJCfy_rzaiBoJoidOBpplNrv6IOrcxgsZBbx2CvwOy8dRefYtH4Qnuo Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Domain-Id: None Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Domain-Name: None Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Identity-Status: Confirmed Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Is-Admin-Project: True Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Domain-Id: default Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Domain-Name: Default Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Name: admin Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Role: admin,reader,member Jun 23 15:54:31.184356 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Roles: admin,reader,member Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/110dee34db4740f989f715e757ee809c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_110dee34db4740f989f715e757ee809c"}]}] Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Tenant: admin Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Tenant-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Tenant-Name: admin Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User: admin Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Domain-Id: default Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Domain-Name: Default Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Id: e9c7fd1e1ef54284a2b594ce3d58fc5a Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Name: admin Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: method: > Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: exception: Flavor 42 could not be found. Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: action_args: {'id': '42'} Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 15:54:31.185941 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:31.187058 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:31.188600 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-12f03c35-294d-4ebe-b53e-729a9b65e1a0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 15:54:31.189961 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-12f03c35-294d-4ebe-b53e-729a9b65e1a0 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.073462 Jun 23 15:54:31.189961 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 19/39] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jun 23 15:54:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 15:54:31.195626 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-db9dfe1e-d25f-4fd9-b231-4252e686e86f admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:31.198495 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:54:31.218096 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-db9dfe1e-d25f-4fd9-b231-4252e686e86f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026230 Jun 23 15:54:31.218649 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 21/40] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 23 15:54:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 15:54:31.228853 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-6398d9fe-743e-4ee2-be96-4951b1ec6e76 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:31.251172 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-6398d9fe-743e-4ee2-be96-4951b1ec6e76 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026319 Jun 23 15:54:31.251732 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 20/41] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 23 15:54:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 15:54:31.261097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-bd24a843-f75c-464b-acd8-a1df4287c10b admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:31.267533 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.wsgi [None req-bd24a843-f75c-464b-acd8-a1df4287c10b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-bd24a843-f75c-464b-acd8-a1df4287c10b admin admin] Request method failure captured: Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Accept: application/json Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Accept-Encoding: gzip, deflate Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Connection: keep-alive Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Content-Length: 0 Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Host: 10.222.0.46 Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Openstack-Api-Version: compute 2.90 Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Openstack-System-Scope: None Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: User-Agent: python-novaclient Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Auth-Token: gAAAAABitIy2_VFSoCDOGleE9__2A06n9vQBQDbv1fTwH0S7L8oDeZ8rmRGnZ1q6pKEw6Lh1dTkMQSbkmBQuyCzoovEUzNUV84tsaWadVfGgKsGiCxk5-NED-JRmzF5gKJCfy_rzaiBoJoidOBpplNrv6IOrcxgsZBbx2CvwOy8dRefYtH4Qnuo Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Domain-Id: None Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Domain-Name: None Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Identity-Status: Confirmed Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Is-Admin-Project: True Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Domain-Id: default Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Domain-Name: Default Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Name: admin Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Role: admin,reader,member Jun 23 15:54:31.270816 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Roles: admin,reader,member Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/110dee34db4740f989f715e757ee809c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_110dee34db4740f989f715e757ee809c"}]}] Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Tenant: admin Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Tenant-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Tenant-Name: admin Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User: admin Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Domain-Id: default Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Domain-Name: Default Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Id: e9c7fd1e1ef54284a2b594ce3d58fc5a Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Name: admin Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: method: > Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: exception: Flavor 42 could not be found. Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: action_args: {'id': '42'} Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 15:54:31.272453 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:31.274281 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:31.275394 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-bd24a843-f75c-464b-acd8-a1df4287c10b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 15:54:31.276393 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-bd24a843-f75c-464b-acd8-a1df4287c10b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014978 Jun 23 15:54:31.276393 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 22/42] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jun 23 15:54:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 15:54:32.103784 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-6398d9fe-743e-4ee2-be96-4951b1ec6e76 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:32.104803 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-6398d9fe-743e-4ee2-be96-4951b1ec6e76 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 23 15:54:32.105198 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 21/43] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:54:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:32.296904 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-f2d29dd1-dc27-4ce6-b0e8-71cc9435b117 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:32.303057 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.wsgi [None req-f2d29dd1-dc27-4ce6-b0e8-71cc9435b117 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-f2d29dd1-dc27-4ce6-b0e8-71cc9435b117 admin admin] Request method failure captured: Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Accept: application/json Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Accept-Encoding: gzip, deflate Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Connection: keep-alive Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Content-Length: 0 Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Host: 10.222.0.46 Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Openstack-Api-Version: compute 2.90 Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Openstack-System-Scope: None Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: User-Agent: python-novaclient Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Auth-Token: gAAAAABitIy4F_Yn5aAs97Y-KtIk1HZIMlv6Hw8JI_ql21tnMIN9_d7293BMvNqVJ2Y9ykKSukkeGx8hNV2jXtES-Mf0O61dyCbbyv9xSfID-XeSexjgrPPae8W14e8seTzxFY_6sJZDJt9992fcl0bSR56mRqUSuk2ntLFbc-ahgdTDJ-TuEn8 Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Domain-Id: None Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Domain-Name: None Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Identity-Status: Confirmed Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Is-Admin-Project: True Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Domain-Id: default Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Domain-Name: Default Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Name: admin Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Role: admin,reader,member Jun 23 15:54:32.304604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Roles: admin,reader,member Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/110dee34db4740f989f715e757ee809c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_110dee34db4740f989f715e757ee809c"}]}] Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Tenant: admin Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Tenant-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Tenant-Name: admin Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User: admin Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Domain-Id: default Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Domain-Name: Default Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Id: e9c7fd1e1ef54284a2b594ce3d58fc5a Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Name: admin Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: method: > Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: exception: Flavor 84 could not be found. Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: action_args: {'id': '84'} Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 15:54:32.306146 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:32.307097 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:32.308148 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-f2d29dd1-dc27-4ce6-b0e8-71cc9435b117 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 15:54:32.309177 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-f2d29dd1-dc27-4ce6-b0e8-71cc9435b117 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061691 Jun 23 15:54:32.309177 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jun 23 15:54:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 15:54:32.315675 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-e562dc56-843e-4101-a172-dd2275f9ebf4 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:32.330748 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-e562dc56-843e-4101-a172-dd2275f9ebf4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018674 Jun 23 15:54:32.331293 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 22/45] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 23 15:54:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 15:54:32.341260 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-12071de7-1f01-497e-94df-0d26b124706e admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:32.355232 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-12071de7-1f01-497e-94df-0d26b124706e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017429 Jun 23 15:54:32.355755 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 24/46] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 23 15:54:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 15:54:32.364853 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-9d0626bd-bc54-4e21-b8fe-21555609f483 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:32.370160 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.wsgi [None req-9d0626bd-bc54-4e21-b8fe-21555609f483 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-9d0626bd-bc54-4e21-b8fe-21555609f483 admin admin] Request method failure captured: Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Accept: application/json Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Accept-Encoding: gzip, deflate Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Connection: keep-alive Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Content-Length: 0 Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Host: 10.222.0.46 Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Openstack-Api-Version: compute 2.90 Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Openstack-System-Scope: None Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: User-Agent: python-novaclient Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Auth-Token: gAAAAABitIy4F_Yn5aAs97Y-KtIk1HZIMlv6Hw8JI_ql21tnMIN9_d7293BMvNqVJ2Y9ykKSukkeGx8hNV2jXtES-Mf0O61dyCbbyv9xSfID-XeSexjgrPPae8W14e8seTzxFY_6sJZDJt9992fcl0bSR56mRqUSuk2ntLFbc-ahgdTDJ-TuEn8 Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Domain-Id: None Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Domain-Name: None Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Identity-Status: Confirmed Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Is-Admin-Project: True Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Domain-Id: default Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Domain-Name: Default Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Name: admin Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Role: admin,reader,member Jun 23 15:54:32.371688 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Roles: admin,reader,member Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/110dee34db4740f989f715e757ee809c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_110dee34db4740f989f715e757ee809c"}]}] Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Tenant: admin Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Tenant-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Tenant-Name: admin Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User: admin Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Domain-Id: default Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Domain-Name: Default Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Id: e9c7fd1e1ef54284a2b594ce3d58fc5a Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Name: admin Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: method: > Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: exception: Flavor 84 could not be found. Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: action_args: {'id': '84'} Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 15:54:32.373173 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:32.374125 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:32.375603 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-9d0626bd-bc54-4e21-b8fe-21555609f483 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 15:54:32.376878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-9d0626bd-bc54-4e21-b8fe-21555609f483 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011687 Jun 23 15:54:32.376878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 23/47] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jun 23 15:54:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 15:54:33.219628 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-12071de7-1f01-497e-94df-0d26b124706e admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:33.220645 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-12071de7-1f01-497e-94df-0d26b124706e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 23 15:54:33.221037 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 25/48] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:54:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:33.412149 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-b6f84580-ab84-49ee-8904-c5823b93547c admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:33.417836 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.wsgi [None req-b6f84580-ab84-49ee-8904-c5823b93547c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-b6f84580-ab84-49ee-8904-c5823b93547c admin admin] Request method failure captured: Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Accept: application/json Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Accept-Encoding: gzip, deflate Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Connection: keep-alive Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Content-Length: 0 Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Host: 10.222.0.46 Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Openstack-Api-Version: compute 2.90 Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Openstack-System-Scope: None Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: User-Agent: python-novaclient Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Auth-Token: gAAAAABitIy5o1rmU9-zGhAmZRDHVHBoNeSpwHyhj-VGCj6T3wDY8XaEXXbboB4hurmXJbLgCWPWRVgTpfZXpOFiWtIzdWakf0x4YrFzC3hDA29hSFGWm0fAevs0PttcrKioNl4cQ7C6CRyVoe7mxeBWetS0tqVTtGoTgZfQ-UxiXxyQkVSpNus Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Domain-Id: None Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Domain-Name: None Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Identity-Status: Confirmed Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Is-Admin-Project: True Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Domain-Id: default Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Domain-Name: Default Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Project-Name: admin Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Role: admin,reader,member Jun 23 15:54:33.419390 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Roles: admin,reader,member Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/110dee34db4740f989f715e757ee809c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_110dee34db4740f989f715e757ee809c"}]}] Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Tenant: admin Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Tenant-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-Tenant-Name: admin Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User: admin Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Domain-Id: default Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Domain-Name: Default Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Id: e9c7fd1e1ef54284a2b594ce3d58fc5a Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: X-User-Name: admin Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: method: > Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: exception: Flavor 451 could not be found. Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: action_args: {'id': '451'} Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 15:54:33.420878 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:33.421788 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: ERROR nova.api.openstack.wsgi Jun 23 15:54:33.423177 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-b6f84580-ab84-49ee-8904-c5823b93547c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103164) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 15:54:33.424384 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-b6f84580-ab84-49ee-8904-c5823b93547c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060708 Jun 23 15:54:33.424384 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 24/49] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 23 15:54:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 15:54:33.430479 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-703cec79-38da-4da7-82e8-7de8be6efbd9 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:33.444734 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-703cec79-38da-4da7-82e8-7de8be6efbd9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017802 Jun 23 15:54:33.445262 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 26/50] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 23 15:54:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 15:54:33.454537 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:33.468695 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017632 Jun 23 15:54:33.469260 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 25/51] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jun 23 15:54:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 15:54:33.478307 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-6b78986b-1b5d-4730-bea0-81acda4f78bb admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:33.483680 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.wsgi [None req-6b78986b-1b5d-4730-bea0-81acda4f78bb admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-6b78986b-1b5d-4730-bea0-81acda4f78bb admin admin] Request method failure captured: Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Accept: application/json Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Accept-Encoding: gzip, deflate Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Connection: keep-alive Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Content-Length: 0 Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Host: 10.222.0.46 Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Openstack-Api-Version: compute 2.90 Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Openstack-System-Scope: None Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: User-Agent: python-novaclient Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Auth-Token: gAAAAABitIy5o1rmU9-zGhAmZRDHVHBoNeSpwHyhj-VGCj6T3wDY8XaEXXbboB4hurmXJbLgCWPWRVgTpfZXpOFiWtIzdWakf0x4YrFzC3hDA29hSFGWm0fAevs0PttcrKioNl4cQ7C6CRyVoe7mxeBWetS0tqVTtGoTgZfQ-UxiXxyQkVSpNus Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Domain-Id: None Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Domain-Name: None Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Identity-Status: Confirmed Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Is-Admin-Project: True Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Domain-Id: default Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Domain-Name: Default Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Project-Name: admin Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Role: admin,reader,member Jun 23 15:54:33.485132 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Roles: admin,reader,member Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/110dee34db4740f989f715e757ee809c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/110dee34db4740f989f715e757ee809c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_110dee34db4740f989f715e757ee809c"}]}] Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Tenant: admin Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Tenant-Id: 110dee34db4740f989f715e757ee809c Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-Tenant-Name: admin Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User: admin Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Domain-Id: default Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Domain-Name: Default Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Id: e9c7fd1e1ef54284a2b594ce3d58fc5a Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: X-User-Name: admin Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: method: > Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: exception: Flavor 451 could not be found. Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: action_args: {'id': '451'} Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 15:54:33.486633 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:33.487936 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: ERROR nova.api.openstack.wsgi Jun 23 15:54:33.489248 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-6b78986b-1b5d-4730-bea0-81acda4f78bb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103163) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 15:54:33.490510 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-6b78986b-1b5d-4730-bea0-81acda4f78bb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011707 Jun 23 15:54:33.490510 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 27/52] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 23 15:54:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 15:54:34.312073 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:34.313091 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 23 15:54:34.313486 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 26/53] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:54:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:34.511934 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-017ab998-c669-4f95-9e13-0b5507ee46b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:54:34.530974 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-017ab998-c669-4f95-9e13-0b5507ee46b1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.076374 Jun 23 15:54:34.531459 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jun 23 15:54:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:54:35.353232 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:35.354224 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Jun 23 15:54:35.354606 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 27/55] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:54:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:35.542474 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-ad08cace-cb01-411f-b948-eb59477d6b5d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:54:35.560158 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-ad08cace-cb01-411f-b948-eb59477d6b5d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070223 Jun 23 15:54:35.560715 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 29/56] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jun 23 15:54:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:54:36.389540 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:36.390555 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 23 15:54:36.391001 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 28/57] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:36.580084 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-2dbeed78-b115-4e4a-8d82-1b8ba6702b2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:54:36.598846 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-2dbeed78-b115-4e4a-8d82-1b8ba6702b2a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072158 Jun 23 15:54:36.599318 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 30/58] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jun 23 15:54:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:54:37.430218 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:37.431282 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 23 15:54:37.431709 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 29/59] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:54:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:37.621378 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-2d756b92-8f02-4b92-8101-beb7801d97a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 15:54:37.640194 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-2d756b92-8f02-4b92-8101-beb7801d97a9 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070537 Jun 23 15:54:37.640634 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 31/60] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jun 23 15:54:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:54:38.454458 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:38.455539 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 23 15:54:38.455937 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 30/61] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:54:38.646261 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-c80392f1-797d-4dc9-902a-2f529d3f9fe4 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:54:38.666071 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-c80392f1-797d-4dc9-902a-2f529d3f9fe4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071083 Jun 23 15:54:38.666531 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 32/62] 10.222.0.46 () {60 vars in 1202 bytes} [Thu Jun 23 15:54:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 15:55:27.523523 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:55:27.524474 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-30b6a872-6e04-409d-a2dd-f155e4d1df80 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 Jun 23 15:55:27.524869 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 31/63] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jun 23 15:55:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:55:27.532457 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:55:27.589357 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-0a9283d7-40f8-49fa-97f2-01efe85d4f70 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:55:27.608930 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-0a9283d7-40f8-49fa-97f2-01efe85d4f70 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.077953 Jun 23 15:55:27.609464 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 33/64] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jun 23 15:55:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 15:55:27.632315 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-1bb86a1c-fbbe-49a4-90f5-dd9cf40c643d admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:55:27.635760 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG dbcounter [-] [103164] Writing DB stats nova_api:SELECT=14 {{(pid=103164) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:55:27.641332 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-1bb86a1c-fbbe-49a4-90f5-dd9cf40c643d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012672 Jun 23 15:55:27.641851 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 32/65] 10.222.0.46 () {60 vars in 1282 bytes} [Thu Jun 23 15:55:27 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:55:27.654068 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-85883a34-4003-446b-ba88-1055a9c72dee admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:55:27.661574 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-85883a34-4003-446b-ba88-1055a9c72dee admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011043 Jun 23 15:55:27.662079 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 34/66] 10.222.0.46 () {60 vars in 1285 bytes} [Thu Jun 23 15:55:27 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 15:55:27.674204 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-9a38fc15-bf5d-48a8-967f-c32d1a5964d7 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:55:27.682427 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-9a38fc15-bf5d-48a8-967f-c32d1a5964d7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011749 Jun 23 15:55:27.683235 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 33/67] 10.222.0.46 () {60 vars in 1285 bytes} [Thu Jun 23 15:55:27 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:55:27.696046 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-5c0b6325-a875-4e1d-8cef-9444605324fe admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:55:27.703790 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-5c0b6325-a875-4e1d-8cef-9444605324fe admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011443 Jun 23 15:55:27.704305 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 35/68] 10.222.0.46 () {60 vars in 1282 bytes} [Thu Jun 23 15:55:27 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 15:58:44.081410 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-9a38fc15-bf5d-48a8-967f-c32d1a5964d7 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:58:44.082417 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-9a38fc15-bf5d-48a8-967f-c32d1a5964d7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 23 15:58:44.082834 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 34/69] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:58:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:58:44.226960 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writing DB stats nova_api:SELECT=6 {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:44.340042 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-4bf3fc79-04a9-486b-8903-742f08e0fe6a admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:58:44.341270 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:58:44.341270 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: warnings.warn(msg) Jun 23 15:58:44.342498 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-4bf3fc79-04a9-486b-8903-742f08e0fe6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:58:44.342970 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-4bf3fc79-04a9-486b-8903-742f08e0fe6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:58:44.343788 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-4bf3fc79-04a9-486b-8903-742f08e0fe6a admin admin] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:58:44.344217 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-4bf3fc79-04a9-486b-8903-742f08e0fe6a admin admin] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:58:44.379760 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-4bf3fc79-04a9-486b-8903-742f08e0fe6a admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154804 Jun 23 15:58:44.380327 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 36/70] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 23 15:58:44 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:58:45.246271 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-9a38fc15-bf5d-48a8-967f-c32d1a5964d7 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:58:45.247327 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-9a38fc15-bf5d-48a8-967f-c32d1a5964d7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001663 Jun 23 15:58:45.247735 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 35/71] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:58:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:58:45.451442 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-74ce701c-3111-4d8e-bc40-523da22ba299 admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:58:45.452655 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:58:45.452655 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: warnings.warn(msg) Jun 23 15:58:45.453796 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-74ce701c-3111-4d8e-bc40-523da22ba299 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:58:45.454244 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-74ce701c-3111-4d8e-bc40-523da22ba299 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:58:45.455064 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-74ce701c-3111-4d8e-bc40-523da22ba299 admin admin] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:58:45.455499 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-74ce701c-3111-4d8e-bc40-523da22ba299 admin admin] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:58:45.475570 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-74ce701c-3111-4d8e-bc40-523da22ba299 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079554 Jun 23 15:58:45.476826 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 37/72] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 23 15:58:45 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 15:58:56.803341 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-9a38fc15-bf5d-48a8-967f-c32d1a5964d7 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:58:56.806326 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-9a38fc15-bf5d-48a8-967f-c32d1a5964d7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004431 Jun 23 15:58:56.807283 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 36/73] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:58:56 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:58:56.964757 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writing DB stats nova_cell0:SELECT=4 {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:56.965505 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writing DB stats nova_cell1:SELECT=4 {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:56.966229 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG dbcounter [-] [103163] Writing DB stats nova_api:SELECT=8 {{(pid=103163) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 15:58:57.047990 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-a1480481-d54f-4889-ba92-e45bae54fffe admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:58:57.049099 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:58:57.049099 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: warnings.warn(msg) Jun 23 15:58:57.050337 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-a1480481-d54f-4889-ba92-e45bae54fffe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:58:57.050869 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-a1480481-d54f-4889-ba92-e45bae54fffe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:58:57.051671 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-a1480481-d54f-4889-ba92-e45bae54fffe admin admin] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:58:57.052134 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-a1480481-d54f-4889-ba92-e45bae54fffe admin admin] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:58:57.083001 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-a1480481-d54f-4889-ba92-e45bae54fffe admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.122663 Jun 23 15:58:57.083604 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 38/74] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 23 15:58:56 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 15:58:57.999181 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: DEBUG nova.api.openstack.wsgi [None req-9a38fc15-bf5d-48a8-967f-c32d1a5964d7 admin admin] Calling method '>' {{(pid=103164) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:58:58.000980 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: INFO nova.api.openstack.requestlog [None req-9a38fc15-bf5d-48a8-967f-c32d1a5964d7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001849 Jun 23 15:58:58.001595 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: [pid: 103164|app: 0|req: 37/75] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jun 23 15:58:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 15:58:58.305603 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG nova.api.openstack.wsgi [None req-21f2b69f-8a95-4218-9b1d-9021deb22a5b admin admin] Calling method '>' {{(pid=103163) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 15:58:58.307400 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 15:58:58.307400 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: warnings.warn(msg) Jun 23 15:58:58.309055 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-21f2b69f-8a95-4218-9b1d-9021deb22a5b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:58:58.309584 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-21f2b69f-8a95-4218-9b1d-9021deb22a5b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:58:58.310463 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-21f2b69f-8a95-4218-9b1d-9021deb22a5b admin admin] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 15:58:58.311027 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: DEBUG oslo_concurrency.lockutils [None req-21f2b69f-8a95-4218-9b1d-9021deb22a5b admin admin] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103163) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 15:58:58.333987 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: INFO nova.api.openstack.requestlog [None req-21f2b69f-8a95-4218-9b1d-9021deb22a5b admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.103244 Jun 23 15:58:58.334516 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: [pid: 103163|app: 0|req: 39/76] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jun 23 15:58:58 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 15:59:54.603586 dv-cinder-835384-9-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 15:59:54.604264 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: Thu Jun 23 15:59:54 2022 - graceful shutdown triggered... Jun 23 15:59:54.604915 dv-cinder-835384-9-iscsi devstack@n-api.service[103164]: Gracefully killing worker 2 (pid: 103164)... Jun 23 15:59:54.605384 dv-cinder-835384-9-iscsi devstack@n-api.service[103163]: Gracefully killing worker 1 (pid: 103163)... Jun 23 15:59:55.605425 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: worker 1 buried after 1 seconds Jun 23 15:59:55.605975 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: worker 2 buried after 1 seconds Jun 23 15:59:55.605975 dv-cinder-835384-9-iscsi devstack@n-api.service[103162]: goodbye to uWSGI. Jun 23 15:59:55.607039 dv-cinder-835384-9-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 15:59:55.607588 dv-cinder-835384-9-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 15:59:55.610413 dv-cinder-835384-9-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 15:59:55.621388 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 15:59:55 2022] *** Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: nodename: dv-cinder-835384-9-iscsi Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: machine: x86_64 Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: clock source: unix Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: pcre jit disabled Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: detected number of CPU cores: 4 Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: current working directory: / Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: detected binary path: /usr/bin/uwsgi-core Jun 23 15:59:55.623592 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: your processes number limit is 47680 Jun 23 15:59:55.624405 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: your memory page size is 4096 bytes Jun 23 15:59:55.624405 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: detected max file descriptor number: 2048 Jun 23 15:59:55.624405 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: lock engine: pthread robust mutexes Jun 23 15:59:55.624405 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: thunder lock: enabled Jun 23 15:59:55.624405 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 15:59:55.624405 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 15:59:55.668285 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: Python main interpreter initialized at 0x557640cdf9c0 Jun 23 15:59:55.668285 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: python threads support enabled Jun 23 15:59:55.668285 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: your server socket listen backlog is limited to 100 connections Jun 23 15:59:55.668285 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: your mercy for graceful operations on workers is 90 seconds Jun 23 15:59:55.668728 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 15:59:55.668728 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: *** Operational MODE: preforking *** Jun 23 15:59:55.668987 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: *** uWSGI is running in multiple interpreter mode *** Jun 23 15:59:55.668987 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: spawned uWSGI master process (pid: 117877) Jun 23 15:59:55.669193 dv-cinder-835384-9-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 15:59:55.670315 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: spawned uWSGI worker 1 (pid: 117890, cores: 1) Jun 23 15:59:55.670315 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: spawned uWSGI worker 2 (pid: 117891, cores: 1) Jun 23 15:59:55.670315 dv-cinder-835384-9-iscsi devstack@n-api.service[117877]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 15:59:56.352602 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 15:59:56.358028 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 15:59:57.572642 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:59:57.572642 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: from cryptography.utils import int_from_bytes Jun 23 15:59:57.573254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:59:57.573254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: from cryptography.utils import int_from_bytes Jun 23 15:59:57.585078 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:59:57.585078 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: from cryptography.utils import int_from_bytes Jun 23 15:59:57.585658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 15:59:57.585658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: from cryptography.utils import int_from_bytes Jun 23 16:00:00.003697 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 16:00:00.004759 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 16:00:00.005518 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 16:00:00.006055 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 16:00:00.006473 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 16:00:00.007048 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.007525 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.008008 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.008487 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.008982 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.009453 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.009935 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.010413 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.010914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.011343 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.012356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.012837 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-9-iscsi {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.013315 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.013772 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.014247 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.014759 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.015222 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.015706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.016163 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.016956 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.017438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.017891 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.018348 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.018868 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.019349 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.019813 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.020296 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.020748 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.021226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.021692 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.022240 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-9-iscsi {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.022760 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.023235 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.023711 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.024275 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.024744 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.025201 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.025947 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.026426 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.026905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.027947 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.028420 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.028786 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 16:00:00.029234 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 16:00:00.029508 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.029631 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 16:00:00.029937 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 16:00:00.030199 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 16:00:00.030408 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.030598 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.030958 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.031182 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.031300 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.031599 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.031910 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.032019 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.032235 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.032563 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.032759 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.032883 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.033207 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.033477 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.033589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.033798 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.034128 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-9-iscsi {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.034344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.034450 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.034775 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.035083 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.035198 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.035408 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.035717 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.035873 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.036046 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.036357 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.036637 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.036876 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.037193 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.037438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.037552 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.037803 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.038147 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.038272 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.038462 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.038795 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.039063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.039172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.039420 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.039720 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.039836 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.040052 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.040377 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.040495 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-9-iscsi {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.040769 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.041090 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.041206 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.041407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.041799 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.041999 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.042135 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.042453 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.042741 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.042847 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.043168 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.043460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.043555 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.043801 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.044129 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.044223 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.044451 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.044776 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.044925 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.045082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.045400 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.045636 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.045739 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.046033 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.046318 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.046421 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.046641 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.046924 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.047154 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.047254 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.047551 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.047823 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.047925 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.048190 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.048450 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.048631 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.048722 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.049016 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.049280 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.049384 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.049641 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.049951 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.050106 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.050260 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.050573 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.050911 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.051047 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.051223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.051535 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.051806 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.051989 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.052154 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.052478 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.052804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.053073 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.053217 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.053427 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.053799 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.053909 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.054074 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.054385 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.054664 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.054804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.055069 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.055384 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.055585 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.055697 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.056029 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.056310 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.056417 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.056641 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.056956 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.057146 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.057259 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.057606 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.057872 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.057987 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.058159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.058466 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.058789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.058907 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.059149 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.059459 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.059640 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.059752 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.060072 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.060354 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.060461 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.060675 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.060987 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.061184 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.061297 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.061596 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.061907 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.062037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.062218 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.062530 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.062864 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.063012 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.063174 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.063501 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.063734 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.063855 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.064122 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.064386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.064492 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.064731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.065041 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.065222 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.065540 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.065829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.065946 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.066793 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.066906 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.066997 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.067073 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.067152 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.067224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.067301 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.067382 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.067493 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.067735 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.067889 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.067991 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.068072 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.068499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.068603 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.068678 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.068748 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.068948 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.069054 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.069216 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.069363 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.069574 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.069669 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.069831 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.069924 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.070141 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.070303 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.070443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.070587 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.070908 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.071148 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.071330 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.071514 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.071683 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.071832 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.072010 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.072205 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.072443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.072599 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.072828 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.073026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.073301 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.073457 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.073601 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.073753 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.073911 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.074055 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.074750 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.074941 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.075085 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.075240 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.075396 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.077119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.077302 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.077459 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.077605 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.077765 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.077923 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.078071 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.078221 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.078402 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.078569 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.078752 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.078906 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.079056 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.079207 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.079358 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.079851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.080091 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.080091 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.080556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.080646 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.080736 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.080827 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.080921 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.081014 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.081098 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.081180 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.081263 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.081358 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.081442 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.081532 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.081696 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.081805 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.081892 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.081892 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.082061 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.082145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.082227 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.082308 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.082308 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.082308 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.082308 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.082623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.082926 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.083069 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.083181 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.083301 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.083422 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.083542 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 16:00:00.083667 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.083759 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.083857 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.083857 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.084036 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.084131 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.084215 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.084304 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.084468 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.084560 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.084809 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.084913 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.085149 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.085250 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.085472 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.085573 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.085788 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.085888 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.086103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.086200 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.086434 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.086575 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.087084 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.087189 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.087275 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.087367 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.087452 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.087533 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.087689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.087818 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.088008 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.088123 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.088332 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.088443 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.088649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.088758 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.088969 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.089078 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.089285 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.089394 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.089594 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.089694 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.090577 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.090710 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.090820 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.090913 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.091126 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.091222 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.091438 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.091554 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.091738 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.091961 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.092057 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.092140 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.092362 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.092469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.092697 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.092789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.092996 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.093091 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.093337 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.093443 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.093649 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.093752 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.093958 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.094059 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.094271 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.094376 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.094587 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.094712 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.094925 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.095017 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.095243 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.095350 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.095554 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.095648 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.095864 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.095955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.096171 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.096275 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.096484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.096595 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.096798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.096987 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.097143 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.097276 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.097424 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.097594 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.097763 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.097927 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.098076 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.098216 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.098363 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.098502 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.098641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.098812 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.098974 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.099079 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.099287 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.099377 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.099594 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.099691 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.099899 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.099992 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.100250 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.100365 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.100518 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.100626 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.100823 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.100925 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.101142 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.101232 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.101472 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.101573 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.101781 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.101873 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.102114 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.102214 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.102425 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.102543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.102754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.102861 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.103069 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.103160 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.103377 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.103476 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.103684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.103779 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.103995 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.104087 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.104303 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.104402 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.104607 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.104701 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.104915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.105015 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.105228 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.105329 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.105559 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.105651 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.105885 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.105975 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.106192 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.106284 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.106505 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.106606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.106844 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.106962 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.107244 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.107360 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.107554 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.107809 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.108161 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.108508 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.108837 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.108975 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.109166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.109318 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.109486 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.109648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.109900 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.110013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.110649 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.110805 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.110890 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.110977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.111050 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.111119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.111245 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.111322 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.111412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.111606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.111690 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.112147 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.112468 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.112801 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.113236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.113356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.113431 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.113501 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.113743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.113824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.114106 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.114205 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.114415 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.114636 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.114779 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.115038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.115162 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.115356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.115451 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.115672 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.115777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.115993 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.116097 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.116305 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.116396 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.116620 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.116714 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.116941 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.117055 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.117260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.117364 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.117551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.117681 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.117873 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.118023 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.118185 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.118278 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.118499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.118637 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.118828 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.118931 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.119138 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.119233 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.119472 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.119628 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.119796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.119958 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.120111 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.120231 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.120416 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.120509 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.120756 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.120900 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.121112 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.121428 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.121531 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.121750 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.121844 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.122064 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.122163 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.122380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.122490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.122715 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.122822 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.123036 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.123152 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.123348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.123437 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.123662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.123753 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.123977 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.124075 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.124287 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.124384 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.124602 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.124693 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.124914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.125004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.125223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.125321 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.125531 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.125620 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.125846 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.125937 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.126157 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.126256 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.126473 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.126573 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.126818 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.126925 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.127154 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.127273 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.127578 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.127685 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.127777 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.127877 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.128076 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.128190 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.128382 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.128483 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.128695 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.128794 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.129009 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.129101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.129326 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.129417 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.129636 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.129726 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.129947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.130037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.130258 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.130349 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.130591 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.130747 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.130917 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.131008 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.131236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.131336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.131541 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.131632 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.131857 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.131958 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.132175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.132267 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.132500 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.132598 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.132811 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.132914 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.133124 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.133214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.133448 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.133552 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.133761 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.133861 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.134073 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.134179 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.134384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.134484 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.134722 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.134832 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.135020 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.135120 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.135331 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.135432 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.135648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.135749 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.135959 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.136066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.136269 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.136364 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.136576 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.137206 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.137423 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.137549 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.137823 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.137920 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.138023 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.138135 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.138329 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.138627 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.138771 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.138978 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.139070 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.139290 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.139381 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.139612 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.139713 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.139933 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.140031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.140240 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.140345 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.140542 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.140635 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.140864 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.140956 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.141179 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.141295 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.141484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.141586 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.141788 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.141887 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.142092 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.142191 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.142453 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.142551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.142802 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.143029 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.143148 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.143381 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.143496 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.143711 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.143804 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.144026 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.144125 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.144336 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.144428 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.144649 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.144747 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.144959 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.145059 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.145271 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.145453 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.145594 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.145799 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.145904 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.146175 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.146267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.146490 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.146590 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.146831 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.146926 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.147151 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.147246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.147466 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.147627 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.147769 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.147889 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.148150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.148276 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.148381 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.148466 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.148699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.148821 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.149012 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.149125 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.149319 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.149422 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.149633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.149732 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.149952 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.150053 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.150308 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.150806 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.150905 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.151150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.151246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.151468 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.151561 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.151790 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.151914 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.152112 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.152234 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.152974 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.153082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.153311 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.153406 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.153642 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.153744 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.153992 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.154106 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.154303 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.154398 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.154618 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.154738 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.154949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.155050 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.155254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.155355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.155563 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.155664 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.155868 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.155957 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.156174 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.156266 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.156484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.156629 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.156790 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.156893 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.157094 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.157186 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.157402 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.157528 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.157731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.157909 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.158187 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.158436 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.158717 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.158981 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.159135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.159300 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.159300 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.159577 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.159748 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.159896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.160049 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.160199 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.160355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.160514 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.160744 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.160907 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.161056 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.161207 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.161207 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.161505 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.161505 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.161797 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.161951 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.162101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.162254 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.162427 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.162581 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.162855 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.163012 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.163166 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.163345 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.163518 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.163674 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.163826 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.163979 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.164130 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.164293 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.164464 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.164620 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.164784 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.164936 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.165089 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.165289 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.165449 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.165614 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.165776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.165941 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.166095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.166269 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.166437 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.166598 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.166775 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.166929 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.167082 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.167252 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.167404 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.167556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.167717 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.167875 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.168059 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.168354 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.168522 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.168674 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.168826 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.168984 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.169159 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.169321 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.169484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.169637 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.169798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.169949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.170121 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.170287 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.170424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.170424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.170773 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.170930 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.171101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.171253 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.171419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.171573 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.171736 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.171889 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.172060 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.172214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.172375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.172531 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.172699 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.172868 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.173034 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.173186 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.173342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.173507 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.173658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.173828 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.173988 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.174151 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.174422 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.174568 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.174746 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.174914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.175045 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.175179 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.175316 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.175460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.175594 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.175864 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176012 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176147 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176258 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176353 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176455 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176543 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176543 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176793 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176891 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.176989 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177074 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177156 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177427 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177525 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177618 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177785 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177867 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.177946 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.178026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.178110 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.178189 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.178267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.178338 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.178433 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.178520 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.178592 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.178778 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.178936 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.179064 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.179288 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.179404 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.179517 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.179661 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.179849 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.180008 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.180167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.180317 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.180477 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.180678 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.180772 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.180991 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.181094 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.181307 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.181398 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.181627 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.181719 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.181940 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.182113 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.182255 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.182435 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.182570 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.182780 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.182891 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.183094 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.183193 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.183415 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.183507 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.183804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.183922 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.184120 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.184227 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.184424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.184528 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.184741 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.184846 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.185049 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.185169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.185358 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.185492 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.185675 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.185810 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.185995 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.186130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.186316 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.186442 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.186620 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.186771 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.186952 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.187091 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.187265 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.187432 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.187570 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.187736 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.187880 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.188048 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.188186 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.188360 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.188497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.188689 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.188900 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.189015 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.189109 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.189321 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.189456 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.189715 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.189821 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.190024 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.190121 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.190334 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.190441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.190646 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.190792 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.190991 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.191094 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.191301 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.191412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.191612 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.191715 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.191917 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.192022 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.192223 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.192354 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.192525 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.192668 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.192833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.192989 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.193135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.193305 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.193570 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.193700 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.193885 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.194008 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.194198 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.194309 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.194500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.194603 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.194833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.194944 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.195148 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.195242 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.195466 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.195562 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.195780 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.195882 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.196090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.196191 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.196510 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.196620 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.196820 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.196926 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.197130 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.197246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.197468 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.197647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.197755 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.197833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.198031 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.198154 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.198375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.198511 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.198829 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.198941 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.199121 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.199895 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.199999 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.200093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.200284 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.200464 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.200617 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.200776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.200937 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.201110 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.201262 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.201360 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.201447 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.201564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.201750 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.201878 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.202066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.202186 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.202395 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.202590 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.202711 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.202927 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.203056 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.203240 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.203342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.203570 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.203678 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.203886 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.204005 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.204216 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.204341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.204519 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.204621 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.204834 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.204923 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.205145 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.205254 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.205470 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.205564 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.205796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.205897 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.206109 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.206207 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.206428 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.206520 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.206772 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.206869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.207099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.207211 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.207424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.207525 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.207741 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.207841 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.208061 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.208162 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.208400 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.208496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.208726 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.208827 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.209053 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.209189 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.209383 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.209492 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.209699 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.209792 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.210007 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.210121 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.210312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.210400 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.210622 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.210772 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.210953 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.211047 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.211289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.211394 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.211571 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.211671 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.211877 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.211977 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.212186 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.212284 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.212495 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.212597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.212803 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.212904 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.213110 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.213203 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.213415 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.213507 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.213736 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.213835 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.214038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.214131 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.214356 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.214470 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.214658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.214862 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.215620 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.215736 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.215919 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.216023 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.216243 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.216343 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.216569 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.216671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.216881 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.217023 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.217187 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.217289 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.217494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.217610 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.217802 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.217909 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.218148 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.218248 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.218455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.218587 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.218803 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.218941 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.219126 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.219953 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.220294 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.220385 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.220385 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.220574 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.220686 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.220686 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.221181 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.221275 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.221359 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.221441 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.221548 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.221548 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.221720 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.222138 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.222260 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.222458 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.222552 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.223010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.223186 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.223351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.223512 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.223665 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.223823 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.223986 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.224137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.224301 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.224413 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.224501 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.224585 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.224704 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.224797 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.225011 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.225105 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.225318 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.225410 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.225645 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.225753 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.226059 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.226166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.226406 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.226555 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.226663 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.226851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.226942 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.227034 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.227191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.227326 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.227523 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.227640 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.227843 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.227943 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.228150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.228249 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.228487 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.228589 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.228810 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.228913 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.229135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.229305 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.229586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.229691 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.229785 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.229877 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.230096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.230203 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.230510 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.230631 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.230812 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.230918 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.231072 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.231220 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.231393 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.231509 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.231712 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.231826 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.232027 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.232134 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.232861 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.233037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.233037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.233198 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.233282 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.233376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.233469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.233553 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.233692 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.233779 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.233987 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.234158 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.234255 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.234446 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.234798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.234896 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.235116 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.235211 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.235474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.235578 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.235749 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.235842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.236064 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.236166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.236375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.236468 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.236689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.236789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.237000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.237101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.237312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.237405 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.237638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.237742 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.237958 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.238050 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.238277 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.238371 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.238591 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.238724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.238944 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.239039 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.239317 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.239524 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.239751 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.239861 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.239861 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.240015 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.240192 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.240449 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.240590 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.240739 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.240948 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.241637 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.242004 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.242150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.242327 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.242404 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.242483 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.242555 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.242680 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.242888 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.243051 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.243221 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.243390 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.243552 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.243552 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.243869 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.244018 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.244182 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.244341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.244562 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.244722 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.244880 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.245038 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.245195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.245352 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.245505 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.245672 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.245843 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.245996 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.246202 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.246352 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.246503 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.246668 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.246895 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.247055 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.247055 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.247345 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.247499 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.247499 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.247813 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.247968 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.248122 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.248277 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.248433 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.248608 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.248758 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.248923 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.249087 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.249259 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.249424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.249649 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.249828 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.249981 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.250142 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.250298 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.250449 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.250615 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.250819 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.250964 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.251118 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.251273 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.251455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.251623 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.251773 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.251923 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.252313 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.252469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.252642 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.252805 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.252966 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.253130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.253294 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.253456 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.253630 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.253863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.253863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.254156 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.254311 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.254459 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.254612 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.254806 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.254950 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.255100 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.255268 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.255447 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.255615 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.255779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.255779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.256067 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.256221 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.256400 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.256555 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.256706 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.256867 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.257018 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.257178 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.257351 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.257505 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.257657 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.257808 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.257808 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.258110 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.258277 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.258428 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.258579 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.258752 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.258907 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.259140 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.259314 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.259470 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.259639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.259796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.259949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.260123 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.260279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.260447 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.260617 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.260788 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.260951 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.261115 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.261270 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.261425 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.261579 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.262277 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.262384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.262480 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.262591 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.262746 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.262854 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.262942 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.263048 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.263135 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.263219 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.263311 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.263399 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.263506 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.263607 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.263708 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.263852 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.264015 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.264170 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.264321 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.264480 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.264634 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.264740 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.264826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.264918 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.265009 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.265097 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.265190 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.265275 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.265360 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.265616 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.265746 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.265934 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.266073 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.266262 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.266385 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.266655 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.266819 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.267019 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.267123 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.267369 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.267462 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.267688 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.267782 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.268076 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.268343 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.268470 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.268699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.268844 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.269022 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.269141 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.269345 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.269447 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.269682 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.269910 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.270105 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.270337 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.270563 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.270831 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.271088 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.271276 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.271276 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.271564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.271564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.271918 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.271918 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.272327 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.272540 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.272699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.272871 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.273037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.273205 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.273345 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.273466 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.273555 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.273640 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.273733 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.273829 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.273955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.274058 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.274145 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.274271 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.274375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.274519 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.274612 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.274719 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.274936 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.275030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.275247 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.275353 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.275826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.275923 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.276135 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.276234 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.276445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.276565 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.276753 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.276887 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.277047 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.277196 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.277419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.278057 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.278205 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.278357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.278512 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.278680 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.278972 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.279108 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.279270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.279442 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.279595 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.279765 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.279924 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.280077 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.280253 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.280416 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.280567 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.280733 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.280897 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.281052 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.281212 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.281361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.281526 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.281675 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.281820 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.281966 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.282115 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.282273 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.282440 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.282611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.282783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.282933 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.283086 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.283239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.283419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.283567 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.283739 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.283906 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.284075 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.284252 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.284407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.284549 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.284701 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.284885 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.285040 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.285200 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.285325 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.285447 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.285585 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.285740 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.285880 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.286047 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.286199 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.286350 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.286511 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.286679 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.287019 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.287196 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.287349 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.287516 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.287681 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.287836 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.288007 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.288159 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.288327 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.288478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.288626 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.288789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.288789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.289071 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.289222 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.289382 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.289600 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.289759 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.289938 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.290162 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.290322 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.290486 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.290636 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.290837 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.291004 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.291152 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.291300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.291518 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.291671 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.291844 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.291997 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.292214 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.292381 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.292534 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.292743 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.292943 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.293106 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.293106 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.293403 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.293551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.293647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.293743 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.293826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.293898 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.293969 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.294039 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.294119 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.294199 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.294271 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.294361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.294435 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.294513 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.294593 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.294666 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.296005 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117891) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 16:00:00.296284 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.296284 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.296284 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.296284 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.296284 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.296791 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.296895 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.297126 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.297477 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.297727 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.298041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.298374 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.298724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.299027 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.299353 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.299671 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.299991 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.300309 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.300620 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.300948 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.301260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.301569 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.301886 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.302201 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.302512 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.302850 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.303169 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.303493 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.303818 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.304140 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.304447 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.304798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.305287 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.305548 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.305895 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.306228 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.306541 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.306877 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.307183 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 16:00:00.307443 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 16:00:00.358786 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO dbcounter [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Registered counter for database nova_api Jun 23 16:00:00.369975 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO dbcounter [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Registered counter for database nova_api Jun 23 16:00:00.380089 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_db.sqlalchemy.engines [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 16:00:00.389304 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writer thread running {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 16:00:00.392030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_db.sqlalchemy.engines [None req-38998319-39c9-4b3f-8313-68016101b23f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 16:00:00.400152 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writer thread running {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 16:00:00.451985 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.context [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b684caf-4cee-45d0-96c0-d4ffe1988b04(cell1) {{(pid=117891) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 16:00:00.456392 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:00:00.456930 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.context [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7b684caf-4cee-45d0-96c0-d4ffe1988b04(cell1) {{(pid=117890) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 16:00:00.458185 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:00:00.459097 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:00:00.461023 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:00:00.461304 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:00:00.462771 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:00:00.463614 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:00:00.463753 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO dbcounter [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Registered counter for database nova_cell0 Jun 23 16:00:00.465956 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:00:00.468136 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO dbcounter [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Registered counter for database nova_cell0 Jun 23 16:00:00.468278 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO dbcounter [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Registered counter for database nova_cell1 Jun 23 16:00:00.472283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO dbcounter [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Registered counter for database nova_cell1 Jun 23 16:00:00.475894 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_db.sqlalchemy.engines [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 16:00:00.477820 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_db.sqlalchemy.engines [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 16:00:00.479329 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_db.sqlalchemy.engines [None req-38998319-39c9-4b3f-8313-68016101b23f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 16:00:00.484607 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_db.sqlalchemy.engines [None req-38998319-39c9-4b3f-8313-68016101b23f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 16:00:00.485294 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writer thread running {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 16:00:00.487849 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writer thread running {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 16:00:00.488186 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writer thread running {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 16:00:00.635289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writer thread running {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 16:00:00.646388 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO dbcounter [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Registered counter for database nova_cell0 Jun 23 16:00:00.647460 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO dbcounter [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Registered counter for database nova_cell0 Jun 23 16:00:00.653992 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_db.sqlalchemy.engines [None req-38998319-39c9-4b3f-8313-68016101b23f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 16:00:00.655622 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_db.sqlalchemy.engines [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117891) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 16:00:00.659045 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writer thread running {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 16:00:00.660101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writer thread running {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 16:00:00.992529 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: WARNING keystonemiddleware.auth_token [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 16:00:00.994330 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: WARNING keystonemiddleware.auth_token [None req-38998319-39c9-4b3f-8313-68016101b23f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 16:00:01.000550 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: WARNING keystonemiddleware.auth_token [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 16:00:01.002259 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: WARNING keystonemiddleware.auth_token [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 16:00:01.352710 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: WARNING keystonemiddleware.auth_token [None req-38998319-39c9-4b3f-8313-68016101b23f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 16:00:01.353889 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: WARNING keystonemiddleware.auth_token [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 16:00:01.359618 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: WARNING keystonemiddleware.auth_token [None req-38998319-39c9-4b3f-8313-68016101b23f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 16:00:01.362463 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: WARNING keystonemiddleware.auth_token [None req-0d189574-532a-4bf6-9ea5-a05329302c19 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 16:00:01.365050 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557640cdf9c0 pid: 117890 (default app) Jun 23 16:00:01.367851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557640cdf9c0 pid: 117891 (default app) Jun 23 16:00:44.108728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:44.111968 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:44.113167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:44.114637 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:46.138547 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d11cf28a-d859-4519-b6b4-14888071a1bd tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Action: 'create', calling method: .version_select at 0x7fe28f48c790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-932658131"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:00:47.808217 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:47.809890 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:47.811690 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:47.815264 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:00:47.967702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d11cf28a-d859-4519-b6b4-14888071a1bd tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.885444 Jun 23 16:00:47.968494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1154 bytes} [Thu Jun 23 16:00:44 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3891 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 23 16:00:47.995915 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e14943a0-a8ec-4414-bc46-bb01af27dee8 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f3535e0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:48.121969 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e14943a0-a8ec-4414-bc46-bb01af27dee8 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43" status: 200 len: 344 microversion: 2.1 time: 0.134312 Jun 23 16:00:48.123785 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 2/2] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:00:47 2022] GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:00:48.322483 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ebda0ee4-679a-4d85-977e-2771a302e913 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28f4d83a0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:49.145392 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5ff70838-5985-42d5-b0ae-635b25f51bf3 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f353700>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:49.319132 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ebda0ee4-679a-4d85-977e-2771a302e913 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/f92e173f-9c96-4378-8408-251794e124e6" status: 200 len: 351 microversion: 2.1 time: 1.530355 Jun 23 16:00:49.335896 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 1/3] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:00:47 2022] GET /compute/v2.1/os-volumes/f92e173f-9c96-4378-8408-251794e124e6 => generated 351 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:00:49.434360 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5ff70838-5985-42d5-b0ae-635b25f51bf3 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43" status: 200 len: 345 microversion: 2.1 time: 0.290415 Jun 23 16:00:49.434360 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 3/4] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:00:49 2022] GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 => generated 345 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:00:49.452315 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-20d24e3c-5cc2-4cb3-a940-bdbe750ff7a2 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Action: 'create', calling method: .version_select at 0x7fe28f3a14c0>, body: {"snapshot": {"volume_id": "49ce160e-260f-4d72-ba6c-7facb29ada43", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1104484946"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:00:50.703905 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-20d24e3c-5cc2-4cb3-a940-bdbe750ff7a2 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.266249 Jun 23 16:00:50.705954 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 2/5] 10.222.0.46 () {60 vars in 1161 bytes} [Thu Jun 23 16:00:49 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:00:50.718237 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-99cbbd57-6934-444b-8c0b-d48d3dd7f68d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f353d30>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:50.849664 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f9ca05dc-e6b0-416e-8e95-4fef235f809b tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28f3a1b80>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:50.922867 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-99cbbd57-6934-444b-8c0b-d48d3dd7f68d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 200 len: 287 microversion: 2.1 time: 0.210911 Jun 23 16:00:50.924454 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 4/6] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:00:50 2022] GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 287 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:00:50.935693 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9481e681-5c2f-4e9c-aa24-7f28b63f8578 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f36c430>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:51.003502 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f9ca05dc-e6b0-416e-8e95-4fef235f809b tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b4dce050-a1c7-4e03-b619-d5f38306e9d0" status: 200 len: 350 microversion: 2.1 time: 0.159418 Jun 23 16:00:51.005054 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 3/7] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:00:50 2022] GET /compute/v2.1/os-volumes/b4dce050-a1c7-4e03-b619-d5f38306e9d0 => generated 350 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:00:51.111144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9481e681-5c2f-4e9c-aa24-7f28b63f8578 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.180577 Jun 23 16:00:51.112355 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 5/8] 10.222.0.46 () {58 vars in 1139 bytes} [Thu Jun 23 16:00:50 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:00:51.126085 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3da43f9d-7eba-444d-916d-64a88effc178 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f3a13a0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:51.257765 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3da43f9d-7eba-444d-916d-64a88effc178 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 200 len: 287 microversion: 2.1 time: 0.138607 Jun 23 16:00:51.263140 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 4/9] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:00:51 2022] GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 287 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:00:52.270977 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8b908f27-befe-434b-a41c-6e17c90e0769 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f35e430>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:52.274216 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-4652963", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "networks": [{"uuid": "598f2b28-6952-4807-9764-9f110b7f27b0"}]}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:00:52.329654 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8b908f27-befe-434b-a41c-6e17c90e0769 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 200 len: 287 microversion: 2.1 time: 0.061823 Jun 23 16:00:52.329654 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 5/10] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:00:52 2022] GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:00:52.430972 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] validate_networks() for [('598f2b28-6952-4807-9764-9f110b7f27b0', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:00:53.343828 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8c121086-e8b3-40f1-aa16-8cf4486cae2d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f3a1a60>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:53.417310 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8c121086-e8b3-40f1-aa16-8cf4486cae2d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 200 len: 287 microversion: 2.1 time: 0.075956 Jun 23 16:00:53.422679 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:00:53 2022] GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:00:54.430424 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a05a4b8c-eb3c-4936-8fa8-69678b451262 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28fcb7af0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:54.520024 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a05a4b8c-eb3c-4936-8fa8-69678b451262 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 200 len: 287 microversion: 2.1 time: 0.094893 Jun 23 16:00:54.524629 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 7/12] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:00:54 2022] GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 287 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:00:54.757084 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:00:54.757664 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:00:54.758265 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:00:54.759209 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:00:54.759747 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:00:54.802102 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:00:54.803963 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:00:54.806538 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:00:54.807753 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:00:54.910802 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Getting quotas for project 27aed572a9da43ca919d77bd579224a9. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:00:54.932195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Getting quotas for user 82e02e90305a424c8e719a92bd084a5f and project 27aed572a9da43ca919d77bd579224a9. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:00:54.947439 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:00:54.951919 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:00:55.132787 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fbfaaa77-3da7-429a-99b9-2e69779147ca tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.131094 Jun 23 16:00:55.137032 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 6/13] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:00:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3139 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:00:55.149040 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1fd0da0a-66f4-418a-8610-622fb5ef4345 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:55.151356 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1fd0da0a-66f4-418a-8610-622fb5ef4345 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:00:55.533786 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ae7f03a8-2444-4273-8dd8-cf365177e761 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28e9ff160>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:55.584710 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1fd0da0a-66f4-418a-8610-622fb5ef4345 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:00:55.618229 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ae7f03a8-2444-4273-8dd8-cf365177e761 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 200 len: 287 microversion: 2.1 time: 0.089119 Jun 23 16:00:55.619140 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 7/14] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:00:55 2022] GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:00:55.628357 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1fd0da0a-66f4-418a-8610-622fb5ef4345 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1212 microversion: 2.1 time: 0.484864 Jun 23 16:00:55.640211 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 8/15] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:00:55 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1212 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:00:56.634984 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-852aa8b3-d3b6-4e62-b22c-c568ba48b659 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f26cee0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:56.648480 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fb27d447-0ca8-4582-9491-d2244b1f640d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:56.649237 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fb27d447-0ca8-4582-9491-d2244b1f640d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:00:56.714679 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-852aa8b3-d3b6-4e62-b22c-c568ba48b659 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 200 len: 287 microversion: 2.1 time: 0.086148 Jun 23 16:00:56.715291 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:00:56 2022] GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:00:57.133488 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fb27d447-0ca8-4582-9491-d2244b1f640d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:00:57.143783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fb27d447-0ca8-4582-9491-d2244b1f640d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1212 microversion: 2.1 time: 0.498920 Jun 23 16:00:57.155489 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 9/17] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:00:56 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1212 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:00:57.732739 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e3b55808-fa39-4478-9fae-545dbf8a46ff tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28e9ff5e0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:57.885003 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e3b55808-fa39-4478-9fae-545dbf8a46ff tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 200 len: 288 microversion: 2.1 time: 0.156981 Jun 23 16:00:57.886018 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 9/18] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:00:57 2022] GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 288 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:00:57.904158 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2e271fb6-1c88-45e2-b813-f7c413bf9f4f tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f328670>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:58.185501 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6fa1d39d-2d35-4eb6-81e2-21e7406c2331 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:58.186662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6fa1d39d-2d35-4eb6-81e2-21e7406c2331 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:00:58.218174 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2e271fb6-1c88-45e2-b813-f7c413bf9f4f tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 202 len: 0 microversion: 2.1 time: 0.315356 Jun 23 16:00:58.228084 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 10/19] 10.222.0.46 () {58 vars in 1253 bytes} [Thu Jun 23 16:00:57 2022] DELETE /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:00:58.249778 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f689529b-3365-4f3b-b7ee-73136550b350 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f328940>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:58.465299 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f689529b-3365-4f3b-b7ee-73136550b350 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 200 len: 287 microversion: 2.1 time: 0.231595 Jun 23 16:00:58.470660 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 11/20] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:00:58 2022] GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 287 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:00:58.615251 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f311b1ae-2866-4bde-b667-45418439ca8f tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28f328a60>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:58.695051 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6fa1d39d-2d35-4eb6-81e2-21e7406c2331 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:00:58.731484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6fa1d39d-2d35-4eb6-81e2-21e7406c2331 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1212 microversion: 2.1 time: 0.544545 Jun 23 16:00:58.747171 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 10/21] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:00:58 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1212 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:00:59.446084 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f311b1ae-2866-4bde-b667-45418439ca8f tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/5ea51585-5404-45bc-bfbf-20567074ee59" status: 200 len: 351 microversion: 2.1 time: 0.836260 Jun 23 16:00:59.447585 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 12/22] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:00:58 2022] GET /compute/v2.1/os-volumes/5ea51585-5404-45bc-bfbf-20567074ee59 => generated 351 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:00:59.460276 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-45192fc0-e867-4517-9adc-3d9af6cf7eff tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28ea0d160>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:59.477974 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9b9c6e2f-edb2-4bba-b1e1-5b1ca6c2e963 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f31b160>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:59.658684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-9b9c6e2f-edb2-4bba-b1e1-5b1ca6c2e963 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] HTTP exception thrown: Snapshot 30decbee-29b8-4011-b92c-271d8aaa4ae1 could not be found. Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9b9c6e2f-edb2-4bba-b1e1-5b1ca6c2e963 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Request method failure captured: Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 HTTP/1.1 Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4rlH2pF8UyRNng7FrwoWsS8jQU8aSmrU_v70MrlvI9oxZyOrO8JQI_Ohx9J2-3tQuQO2ne2vIxspvpyTbGmVQkAPwxHKTdHiM5DokI3Sg1Aj6hsUOeU2et0b8kK04D1GJGpgrlaXeR4KAZxqbgnxcd6jaf3qAa-A7Slwi2VOm1pXQ Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 80d7b052110b4d61afa8de89a996b580 Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:00:59.683583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_80d7b052110b4d61afa8de89a996b580"}]}] Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 80d7b052110b4d61afa8de89a996b580 Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesSnapshotsTestJSON-259982777-project Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: d887ce5851b5410094f1bd83120935c1 Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesSnapshotsTestJSON-259982777-project Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Snapshot 30decbee-29b8-4011-b92c-271d8aaa4ae1 could not be found. Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '30decbee-29b8-4011-b92c-271d8aaa4ae1'} Jun 23 16:00:59.690066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 30decbee-29b8-4011-b92c-271d8aaa4ae1 could not be found. (HTTP 404) (Request-ID: req-651fc6d1-9b12-4f3d-8468-c2d9f5a48111) Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:00:59.694036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 16:00:59.697647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 30decbee-29b8-4011-b92c-271d8aaa4ae1 could not be found. Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 16:00:59.703444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 30decbee-29b8-4011-b92c-271d8aaa4ae1 could not be found. Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 30decbee-29b8-4011-b92c-271d8aaa4ae1 could not be found. Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9b9c6e2f-edb2-4bba-b1e1-5b1ca6c2e963 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Returning 404 to user: Snapshot 30decbee-29b8-4011-b92c-271d8aaa4ae1 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9b9c6e2f-edb2-4bba-b1e1-5b1ca6c2e963 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1" status: 404 len: 111 microversion: 2.1 time: 0.212973 Jun 23 16:00:59.710915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 13/23] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:00:59 2022] GET /compute/v2.1/os-snapshots/30decbee-29b8-4011-b92c-271d8aaa4ae1 => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 16:00:59.738573 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8cc34c33-ba1c-4df8-b19a-5d5f1318447d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f2894c0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:59.922518 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8cc34c33-ba1c-4df8-b19a-5d5f1318447d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43" status: 202 len: 0 microversion: 2.1 time: 0.214729 Jun 23 16:00:59.923025 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-45192fc0-e867-4517-9adc-3d9af6cf7eff tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.467086 Jun 23 16:00:59.923715 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 14/24] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 23 16:00:59 2022] DELETE /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:00:59.932673 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 11/25] 10.222.0.46 () {58 vars in 1133 bytes} [Thu Jun 23 16:00:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:00:59.932883 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3d5477a8-d50e-4332-aa29-f041a4898bde tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:59.932883 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3d5477a8-d50e-4332-aa29-f041a4898bde tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:00:59.934604 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e317989c-e32f-4aa6-ab85-4d781b3e214f tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28ea2ab80>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:00:59.960450 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d5477a8-d50e-4332-aa29-f041a4898bde tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:00:59.961035 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d5477a8-d50e-4332-aa29-f041a4898bde tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:00:59.961808 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d5477a8-d50e-4332-aa29-f041a4898bde tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:00:59.962616 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3d5477a8-d50e-4332-aa29-f041a4898bde tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:00.059766 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e317989c-e32f-4aa6-ab85-4d781b3e214f tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43" status: 200 len: 344 microversion: 2.1 time: 0.131957 Jun 23 16:01:00.064736 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 12/26] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:00:59 2022] GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 => generated 344 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:00.065940 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-34dcaafb-5b13-47f0-99d7-4254d35b6e70 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28e1b4280>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:00.248015 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-34dcaafb-5b13-47f0-99d7-4254d35b6e70 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.185753 Jun 23 16:01:00.249220 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 13/27] 10.222.0.46 () {58 vars in 1148 bytes} [Thu Jun 23 16:01:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:00.265902 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-506cbc67-0469-4e5a-b81a-fc8df920a132 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28ea2aa60>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:00.553425 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-506cbc67-0469-4e5a-b81a-fc8df920a132 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.291782 Jun 23 16:01:00.554657 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 14/28] 10.222.0.46 () {58 vars in 1133 bytes} [Thu Jun 23 16:01:00 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:00.574576 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-616522ae-07f9-4ae9-ab3b-b35eea24d7f2 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28ea0d3a0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:00.610256 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3d5477a8-d50e-4332-aa29-f041a4898bde tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:00.671017 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3d5477a8-d50e-4332-aa29-f041a4898bde tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1272 microversion: 2.1 time: 0.745549 Jun 23 16:01:00.693476 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 15/29] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:00:59 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1272 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:00.790921 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-616522ae-07f9-4ae9-ab3b-b35eea24d7f2 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.225434 Jun 23 16:01:00.792255 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 15/30] 10.222.0.46 () {58 vars in 1166 bytes} [Thu Jun 23 16:01:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:01:00.804224 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7a35ed9d-54bd-4f57-80b6-d447403f743e tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28f222280>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:00.929951 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7a35ed9d-54bd-4f57-80b6-d447403f743e tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.128565 Jun 23 16:01:00.930809 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 16/31] 10.222.0.46 () {58 vars in 1169 bytes} [Thu Jun 23 16:01:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:00.946142 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1cdf8851-061e-4b9b-a4c3-2bd68f3a2713 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28e1b4430>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:01.073672 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c80949b1-9463-41c8-a16c-fbd17ac50e44 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28f1cc4c0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:01.237612 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1cdf8851-061e-4b9b-a4c3-2bd68f3a2713 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.295858 Jun 23 16:01:01.238563 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 16/32] 10.222.0.46 () {58 vars in 1154 bytes} [Thu Jun 23 16:01:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:01.254611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-38be248a-7355-4413-8c03-7650cae28efe tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28e1b40d0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:01.280589 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c80949b1-9463-41c8-a16c-fbd17ac50e44 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43" status: 200 len: 344 microversion: 2.1 time: 0.211784 Jun 23 16:01:01.281296 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 17/33] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:01:01 2022] GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:01.399281 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-38be248a-7355-4413-8c03-7650cae28efe tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.148290 Jun 23 16:01:01.401246 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 17/34] 10.222.0.46 () {58 vars in 1187 bytes} [Thu Jun 23 16:01:01 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:01.424413 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fbddbceb-2494-48ed-8a60-09ef83e4f929 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] Calling method '.version_select at 0x7fe28f1ccb80>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:01.585074 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fbddbceb-2494-48ed-8a60-09ef83e4f929 tempest-VolumesTestJSON-956972259 tempest-VolumesTestJSON-956972259-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.171740 Jun 23 16:01:01.586422 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 18/35] 10.222.0.46 () {58 vars in 1154 bytes} [Thu Jun 23 16:01:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:01.701463 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e406782b-cfc1-4e19-a6c1-252eea77f6ac tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:01.702967 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e406782b-cfc1-4e19-a6c1-252eea77f6ac tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:01.727135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e406782b-cfc1-4e19-a6c1-252eea77f6ac tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:01.727586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e406782b-cfc1-4e19-a6c1-252eea77f6ac tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:01.728382 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e406782b-cfc1-4e19-a6c1-252eea77f6ac tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:01.728865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e406782b-cfc1-4e19-a6c1-252eea77f6ac tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:01.996856 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1864062139", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:02.169985 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] validate_networks() for [('be160518-64d3-490b-aa6f-8ddd417753d6', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:01:02.348209 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e406782b-cfc1-4e19-a6c1-252eea77f6ac tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:02.381969 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e406782b-cfc1-4e19-a6c1-252eea77f6ac tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1272 microversion: 2.1 time: 0.685943 Jun 23 16:01:02.383575 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 18/36] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:01 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1272 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:02.393988 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c5468538-f282-4505-a727-29b409d89467 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28fcb99d0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:02.519368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c5468538-f282-4505-a727-29b409d89467 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43" status: 200 len: 344 microversion: 2.1 time: 0.133391 Jun 23 16:01:02.521141 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 19/37] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:01:02 2022] GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:02.690570 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0e2cad8f-a221-4bbb-a2e9-917f0ad29ef2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Action: 'create', calling method: .version_select at 0x7fe28e132700>, body: {"keypair": {"name": "tempest-keypair-1689879792", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQTYrm5O/aSb7I0SWLWaepjPE9ZlQWXyli18y4PtkmzUOkCt+D2RgFv+BnJKBhHfkK2Zk7asfL/v2JfnbMZoayVfZP61npxdRkG5pDruktRLk6e7jsw4xIjKjj0UpymBg=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:02.732660 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-0e2cad8f-a221-4bbb-a2e9-917f0ad29ef2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Getting quotas for project 7412ae4990fa4fe782cc4c5e3db00d75. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:01:02.743799 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-0e2cad8f-a221-4bbb-a2e9-917f0ad29ef2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Getting quotas for user 5dd4357556944c7089efb34ee58a8e04 and project 7412ae4990fa4fe782cc4c5e3db00d75. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:01:02.823278 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0e2cad8f-a221-4bbb-a2e9-917f0ad29ef2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.300878 Jun 23 16:01:02.828499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 20/38] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jun 23 16:01:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 307 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 16:01:03.403365 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1d679651-23d0-44cc-aefc-b92430f0d2d8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:03.404718 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1d679651-23d0-44cc-aefc-b92430f0d2d8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:03.418365 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1d679651-23d0-44cc-aefc-b92430f0d2d8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:03.419964 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1d679651-23d0-44cc-aefc-b92430f0d2d8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:03.424504 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1d679651-23d0-44cc-aefc-b92430f0d2d8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:03.426373 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1d679651-23d0-44cc-aefc-b92430f0d2d8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:03.604586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1d679651-23d0-44cc-aefc-b92430f0d2d8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:03.615972 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1d679651-23d0-44cc-aefc-b92430f0d2d8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1270 microversion: 2.1 time: 0.218604 Jun 23 16:01:03.618619 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 21/39] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:03 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1270 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:03.635625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c215d39a-5a8b-4f5c-9e9e-909e5e094596 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28e0ee430>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:03.752858 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c215d39a-5a8b-4f5c-9e9e-909e5e094596 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43" status: 200 len: 344 microversion: 2.1 time: 0.129600 Jun 23 16:01:03.753476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 22/40] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:01:03 2022] GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:04.004604 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-487583ec-669c-435e-b251-6a8b6cc12bee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: .version_select at 0x7fe28e0eed30>, body: {"keypair": {"name": "tempest-keypair-1242117316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHmpUQ6OXGUEV/oHS267sRZKLTvLc/eak+VHo1gZbIPoL/OEdhsz8/o57tloQrehOYmBd+ho7ad3XO0Mml/mJHFHkPq28rTnFKdt5aBAcOcOVEmlUxl3fB+tZyn4hKkDVA=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:04.041792 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-487583ec-669c-435e-b251-6a8b6cc12bee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for project 2063fb24abb5408794361a9032e56d3f. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:01:04.050885 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-487583ec-669c-435e-b251-6a8b6cc12bee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for user dac5e323b42f41859c85709a2b49623b and project 2063fb24abb5408794361a9032e56d3f. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:01:04.129305 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-487583ec-669c-435e-b251-6a8b6cc12bee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.373770 Jun 23 16:01:04.131405 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 23/41] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 23 16:01:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:04.637842 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f7752579-b07a-4f93-a697-ae5add49d89f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:04.639444 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f7752579-b07a-4f93-a697-ae5add49d89f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:04.665680 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7752579-b07a-4f93-a697-ae5add49d89f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:04.699102 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7752579-b07a-4f93-a697-ae5add49d89f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:04.703856 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7752579-b07a-4f93-a697-ae5add49d89f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:04.711167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7752579-b07a-4f93-a697-ae5add49d89f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:04.872062 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:05.403013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f7752579-b07a-4f93-a697-ae5add49d89f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:05.424192 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f7752579-b07a-4f93-a697-ae5add49d89f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1270 microversion: 2.1 time: 0.790975 Jun 23 16:01:05.436251 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 24/42] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:04 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1270 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:05.458556 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-60c8d402-e7e6-4ce7-ad61-70c38587b104 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28e0ee5e0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:05.548574 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-60c8d402-e7e6-4ce7-ad61-70c38587b104 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] HTTP exception thrown: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-60c8d402-e7e6-4ce7-ad61-70c38587b104 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Request method failure captured: Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 HTTP/1.1 Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4rlH2pF8UyRNng7FrwoWsS8jQU8aSmrU_v70MrlvI9oxZyOrO8JQI_Ohx9J2-3tQuQO2ne2vIxspvpyTbGmVQkAPwxHKTdHiM5DokI3Sg1Aj6hsUOeU2et0b8kK04D1GJGpgrlaXeR4KAZxqbgnxcd6jaf3qAa-A7Slwi2VOm1pXQ Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 80d7b052110b4d61afa8de89a996b580 Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:01:05.553833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_80d7b052110b4d61afa8de89a996b580"}]}] Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 80d7b052110b4d61afa8de89a996b580 Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesSnapshotsTestJSON-259982777-project Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: d887ce5851b5410094f1bd83120935c1 Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesSnapshotsTestJSON-259982777-project Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '49ce160e-260f-4d72-ba6c-7facb29ada43'} Jun 23 16:01:05.555095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. (HTTP 404) (Request-ID: req-526a59b8-a50b-464e-b84d-f52248cd75ab) Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:01:05.555909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 16:01:05.557497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 16:01:05.558650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.566840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.568586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-60c8d402-e7e6-4ce7-ad61-70c38587b104 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Returning 404 to user: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:01:05.569671 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-60c8d402-e7e6-4ce7-ad61-70c38587b104 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43" status: 404 len: 109 microversion: 2.1 time: 0.132329 Jun 23 16:01:05.576284 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 25/43] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:01:05 2022] GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 => generated 109 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:01:05.586426 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b5961657-9eea-4ad9-a27e-c6414991e035 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28fcb9af0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:05.671219 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:01:05.674320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-b5961657-9eea-4ad9-a27e-c6414991e035 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] HTTP exception thrown: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.675621 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b5961657-9eea-4ad9-a27e-c6414991e035 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Request method failure captured: Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 HTTP/1.1 Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4rlH2pF8UyRNng7FrwoWsS8jQU8aSmrU_v70MrlvI9oxZyOrO8JQI_Ohx9J2-3tQuQO2ne2vIxspvpyTbGmVQkAPwxHKTdHiM5DokI3Sg1Aj6hsUOeU2et0b8kK04D1GJGpgrlaXeR4KAZxqbgnxcd6jaf3qAa-A7Slwi2VOm1pXQ Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 80d7b052110b4d61afa8de89a996b580 Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:01:05.676641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_80d7b052110b4d61afa8de89a996b580"}]}] Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 80d7b052110b4d61afa8de89a996b580 Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesSnapshotsTestJSON-259982777-project Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: d887ce5851b5410094f1bd83120935c1 Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesSnapshotsTestJSON-259982777-project Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '49ce160e-260f-4d72-ba6c-7facb29ada43'} Jun 23 16:01:05.678129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. (HTTP 404) (Request-ID: req-06bc491e-4d35-427d-8e96-3713800d8bc4) Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:01:05.679380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 16:01:05.680754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 16:01:05.682485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.683706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b5961657-9eea-4ad9-a27e-c6414991e035 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Returning 404 to user: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:01:05.685037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b5961657-9eea-4ad9-a27e-c6414991e035 tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43" status: 404 len: 109 microversion: 2.1 time: 0.103370 Jun 23 16:01:05.686144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 26/44] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 23 16:01:05 2022] DELETE /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:01:05.688358 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:01:05.688985 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:01:05.689558 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:01:05.701788 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6b9bb7a4-917a-42cd-8290-a149afa6578d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Calling method '.version_select at 0x7fe28e0ee700>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:05.734645 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:05.736974 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:05.738426 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:05.741168 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:05.748417 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-6b9bb7a4-917a-42cd-8290-a149afa6578d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] HTTP exception thrown: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6b9bb7a4-917a-42cd-8290-a149afa6578d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Request method failure captured: Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 HTTP/1.1 Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4rlH2pF8UyRNng7FrwoWsS8jQU8aSmrU_v70MrlvI9oxZyOrO8JQI_Ohx9J2-3tQuQO2ne2vIxspvpyTbGmVQkAPwxHKTdHiM5DokI3Sg1Aj6hsUOeU2et0b8kK04D1GJGpgrlaXeR4KAZxqbgnxcd6jaf3qAa-A7Slwi2VOm1pXQ Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 80d7b052110b4d61afa8de89a996b580 Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:01:05.751476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/80d7b052110b4d61afa8de89a996b580"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_80d7b052110b4d61afa8de89a996b580"}]}] Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 80d7b052110b4d61afa8de89a996b580 Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-259982777 Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesSnapshotsTestJSON-259982777-project Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: d887ce5851b5410094f1bd83120935c1 Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesSnapshotsTestJSON-259982777-project Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '49ce160e-260f-4d72-ba6c-7facb29ada43'} Jun 23 16:01:05.753044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. (HTTP 404) (Request-ID: req-29e40187-505c-4a14-a2bf-afc4871bc48e) Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:01:05.753724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 16:01:05.754625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 16:01:05.757279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. Jun 23 16:01:05.758213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:01:05.762476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6b9bb7a4-917a-42cd-8290-a149afa6578d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] Returning 404 to user: Volume 49ce160e-260f-4d72-ba6c-7facb29ada43 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:01:05.763634 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6b9bb7a4-917a-42cd-8290-a149afa6578d tempest-VolumesSnapshotsTestJSON-259982777 tempest-VolumesSnapshotsTestJSON-259982777-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43" status: 404 len: 109 microversion: 2.1 time: 0.073630 Jun 23 16:01:05.764747 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 27/45] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:01:05 2022] GET /compute/v2.1/os-volumes/49ce160e-260f-4d72-ba6c-7facb29ada43 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:01:05.863138 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Getting quotas for project f9eeca1030964294b8d813812abdcc5b. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:01:05.888405 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Getting quotas for user 228e5acf4578494ab1a28e4f530233f2 and project f9eeca1030964294b8d813812abdcc5b. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:01:05.941321 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:01:05.951916 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:01:06.174363 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dabccbb8-ee72-46e1-911f-a198b2323d8e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.379317 Jun 23 16:01:06.175406 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 19/46] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:01:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 4382 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 16:01:06.190601 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-068753aa-ca7b-454f-a3db-9444424ba6c2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:06.191984 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-068753aa-ca7b-454f-a3db-9444424ba6c2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:06.442720 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c7180898-8bf4-4aa2-937a-3425dd73a04e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:06.445214 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c7180898-8bf4-4aa2-937a-3425dd73a04e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:06.499974 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c7180898-8bf4-4aa2-937a-3425dd73a04e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:06.500796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c7180898-8bf4-4aa2-937a-3425dd73a04e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:06.502774 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c7180898-8bf4-4aa2-937a-3425dd73a04e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:06.503473 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c7180898-8bf4-4aa2-937a-3425dd73a04e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:06.656442 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-068753aa-ca7b-454f-a3db-9444424ba6c2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:06.674152 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-068753aa-ca7b-454f-a3db-9444424ba6c2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1222 microversion: 2.1 time: 0.488535 Jun 23 16:01:06.678132 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 28/47] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:06 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1222 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:06.960413 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c7180898-8bf4-4aa2-937a-3425dd73a04e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:06.989436 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c7180898-8bf4-4aa2-937a-3425dd73a04e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1270 microversion: 2.1 time: 0.551545 Jun 23 16:01:07.001181 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 20/48] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:06 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1270 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:07.117126 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1706943830", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:07.441108 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] validate_networks() for [('be160518-64d3-490b-aa6f-8ddd417753d6', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:01:08.019345 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-590daafd-eb13-4759-99bf-979822606448 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:08.019902 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-590daafd-eb13-4759-99bf-979822606448 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:08.051692 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-590daafd-eb13-4759-99bf-979822606448 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:08.052152 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-590daafd-eb13-4759-99bf-979822606448 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:08.056430 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-590daafd-eb13-4759-99bf-979822606448 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:08.057475 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-590daafd-eb13-4759-99bf-979822606448 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:08.479985 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-590daafd-eb13-4759-99bf-979822606448 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:08.507993 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-590daafd-eb13-4759-99bf-979822606448 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.492746 Jun 23 16:01:08.530741 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 21/49] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:08 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:09.534726 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7de05f8a-9dd1-4e6f-9258-708304a9d42f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:09.535646 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7de05f8a-9dd1-4e6f-9258-708304a9d42f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:09.557013 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7de05f8a-9dd1-4e6f-9258-708304a9d42f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:09.557759 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7de05f8a-9dd1-4e6f-9258-708304a9d42f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:09.558834 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7de05f8a-9dd1-4e6f-9258-708304a9d42f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:09.559449 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7de05f8a-9dd1-4e6f-9258-708304a9d42f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:09.648064 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:01:09.648626 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:01:09.649228 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:01:09.649721 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:01:09.650294 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:01:09.678400 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:09.679033 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:09.689289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:09.695109 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:09.755574 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Getting quotas for project f9eeca1030964294b8d813812abdcc5b. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:01:09.768271 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Getting quotas for user 228e5acf4578494ab1a28e4f530233f2 and project f9eeca1030964294b8d813812abdcc5b. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:01:09.799188 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:01:09.802905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:01:09.955546 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3bb829a6-76c0-4114-86a0-43bf0bc118e1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.847052 Jun 23 16:01:09.956249 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 29/50] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:01:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 2850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:01:09.971700 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-37c7d01a-ccef-402f-a8a6-d997633df8b4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:09.972613 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-37c7d01a-ccef-402f-a8a6-d997633df8b4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:10.040574 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7de05f8a-9dd1-4e6f-9258-708304a9d42f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:10.065401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7de05f8a-9dd1-4e6f-9258-708304a9d42f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.530730 Jun 23 16:01:10.068819 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 22/51] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:09 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:10.333202 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-37c7d01a-ccef-402f-a8a6-d997633df8b4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:10.345304 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-37c7d01a-ccef-402f-a8a6-d997633df8b4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1222 microversion: 2.1 time: 0.382526 Jun 23 16:01:10.350563 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 30/52] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:09 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1222 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:11.098773 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b274e1f5-db5b-45e7-945f-23f8c2d9f50a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:11.101900 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b274e1f5-db5b-45e7-945f-23f8c2d9f50a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:11.180671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b274e1f5-db5b-45e7-945f-23f8c2d9f50a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:11.188830 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b274e1f5-db5b-45e7-945f-23f8c2d9f50a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:11.193677 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b274e1f5-db5b-45e7-945f-23f8c2d9f50a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:11.203557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b274e1f5-db5b-45e7-945f-23f8c2d9f50a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:11.366466 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-88d55d40-eab6-4d94-9685-b593025c69db tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:11.367147 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-88d55d40-eab6-4d94-9685-b593025c69db tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:11.401966 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-88d55d40-eab6-4d94-9685-b593025c69db tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:11.405459 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-88d55d40-eab6-4d94-9685-b593025c69db tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:11.409197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-88d55d40-eab6-4d94-9685-b593025c69db tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:11.414009 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-88d55d40-eab6-4d94-9685-b593025c69db tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:11.725386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-88d55d40-eab6-4d94-9685-b593025c69db tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:11.741597 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-88d55d40-eab6-4d94-9685-b593025c69db tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1226 microversion: 2.1 time: 0.381487 Jun 23 16:01:11.742463 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 31/53] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:11 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1226 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:11.784837 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-557227756", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "780de197-01bd-4423-a125-1dd611f3e7a3"}], "security_groups": [{"name": "tempest-securitygroup--759370006"}], "key_name": "tempest-keypair-1689879792", "user_data": "}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:12.316541 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] validate_networks() for [('780de197-01bd-4423-a125-1dd611f3e7a3', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:01:12.893648 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b274e1f5-db5b-45e7-945f-23f8c2d9f50a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:12.960306 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b274e1f5-db5b-45e7-945f-23f8c2d9f50a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 1.877461 Jun 23 16:01:12.974258 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 23/54] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:11 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:13.017827 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e56949af-2281-4451-a4ba-5c9e8b194e21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:13.019014 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e56949af-2281-4451-a4ba-5c9e8b194e21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:13.074393 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e56949af-2281-4451-a4ba-5c9e8b194e21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:13.077157 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e56949af-2281-4451-a4ba-5c9e8b194e21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:13.081155 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e56949af-2281-4451-a4ba-5c9e8b194e21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:13.083276 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e56949af-2281-4451-a4ba-5c9e8b194e21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:13.719270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e56949af-2281-4451-a4ba-5c9e8b194e21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:13.746202 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e56949af-2281-4451-a4ba-5c9e8b194e21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1274 microversion: 2.1 time: 0.753747 Jun 23 16:01:13.747067 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 24/55] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:12 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1274 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:13.781621 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1662819124", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58e7bb1c-ec3e-4fa3-be98-70515568e1d4"}], "security_groups": [{"name": "tempest-securitygroup--1720723464"}], "key_name": "tempest-keypair-1242117316", "user_data": "}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:14.657317 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:01:14.658501 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:01:14.659238 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:01:14.659859 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:01:14.660568 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:01:14.663329 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=8 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:14.690839 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:14.691825 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:14.694452 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:14.695296 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:14.721824 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] validate_networks() for [('58e7bb1c-ec3e-4fa3-be98-70515568e1d4', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:01:14.744182 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Getting quotas for project 7412ae4990fa4fe782cc4c5e3db00d75. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:01:14.757944 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Getting quotas for user 5dd4357556944c7089efb34ee58a8e04 and project 7412ae4990fa4fe782cc4c5e3db00d75. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:01:14.799198 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:01:14.805558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:01:14.889731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a812c476-2731-4ad4-af79-29f15b357f45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.136353 Jun 23 16:01:14.891158 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 32/56] 10.222.0.46 () {62 vars in 1187 bytes} [Thu Jun 23 16:01:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 3140 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 16:01:14.898996 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-16920f5e-6d90-4949-89cb-78df5e4381f7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:14.901332 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-16920f5e-6d90-4949-89cb-78df5e4381f7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:14.910648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-16920f5e-6d90-4949-89cb-78df5e4381f7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:14.912344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-16920f5e-6d90-4949-89cb-78df5e4381f7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:14.914226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-16920f5e-6d90-4949-89cb-78df5e4381f7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:14.914982 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-16920f5e-6d90-4949-89cb-78df5e4381f7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:15.815202 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:15.922252 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=10 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:16.242158 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-16920f5e-6d90-4949-89cb-78df5e4381f7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:16.257825 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-16920f5e-6d90-4949-89cb-78df5e4381f7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 1.361971 Jun 23 16:01:16.266834 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 33/57] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:14 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:16.272407 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-553f6aff-8cea-4314-8829-1d07c2c379f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:16.280416 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-553f6aff-8cea-4314-8829-1d07c2c379f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:16.303933 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-553f6aff-8cea-4314-8829-1d07c2c379f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:16.306110 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-553f6aff-8cea-4314-8829-1d07c2c379f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:16.309028 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-553f6aff-8cea-4314-8829-1d07c2c379f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:16.311081 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-553f6aff-8cea-4314-8829-1d07c2c379f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:16.630196 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-553f6aff-8cea-4314-8829-1d07c2c379f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:16.654595 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-553f6aff-8cea-4314-8829-1d07c2c379f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1280 microversion: 2.1 time: 0.386442 Jun 23 16:01:16.659954 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 34/58] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:16 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1280 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:16.673646 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3e31ec7b-bc02-455a-abda-b01549b337f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:16.674384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3e31ec7b-bc02-455a-abda-b01549b337f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:16.692589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3e31ec7b-bc02-455a-abda-b01549b337f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:16.693714 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3e31ec7b-bc02-455a-abda-b01549b337f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:16.699560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3e31ec7b-bc02-455a-abda-b01549b337f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:16.700608 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3e31ec7b-bc02-455a-abda-b01549b337f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:17.190497 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3e31ec7b-bc02-455a-abda-b01549b337f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:17.211026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3e31ec7b-bc02-455a-abda-b01549b337f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:17.213317 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3e31ec7b-bc02-455a-abda-b01549b337f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:17.223249 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3e31ec7b-bc02-455a-abda-b01549b337f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1277 microversion: 2.20 time: 0.562000 Jun 23 16:01:17.224613 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 35/59] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:16 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1277 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:17.276364 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-05ed212b-a057-46fd-b5dc-7e6bb6ccedb8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:17.277867 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-05ed212b-a057-46fd-b5dc-7e6bb6ccedb8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:17.314726 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-05ed212b-a057-46fd-b5dc-7e6bb6ccedb8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:17.315600 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-05ed212b-a057-46fd-b5dc-7e6bb6ccedb8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:17.316627 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-05ed212b-a057-46fd-b5dc-7e6bb6ccedb8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:17.317251 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-05ed212b-a057-46fd-b5dc-7e6bb6ccedb8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:18.334249 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:01:18.335574 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:01:18.336338 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:01:18.336992 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:01:18.338176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:01:18.362724 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:18.363521 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:18.367611 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:18.369963 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:18.441597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for project 2063fb24abb5408794361a9032e56d3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:01:18.444706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-05ed212b-a057-46fd-b5dc-7e6bb6ccedb8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:18.453495 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:18.453719 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-05ed212b-a057-46fd-b5dc-7e6bb6ccedb8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 1.182436 Jun 23 16:01:18.458904 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for user dac5e323b42f41859c85709a2b49623b and project 2063fb24abb5408794361a9032e56d3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:01:18.460318 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 36/60] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:17 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:18.484783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c3949532-c4e7-4064-9cd5-19a17efcd6f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:18.492826 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c3949532-c4e7-4064-9cd5-19a17efcd6f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:18.507728 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:01:18.518352 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:01:18.533936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c3949532-c4e7-4064-9cd5-19a17efcd6f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:18.546330 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c3949532-c4e7-4064-9cd5-19a17efcd6f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:18.552871 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c3949532-c4e7-4064-9cd5-19a17efcd6f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:18.553788 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c3949532-c4e7-4064-9cd5-19a17efcd6f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:18.731653 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-11addada-dc31-4884-aadf-f0f12a751be1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.983663 Jun 23 16:01:18.736812 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 25/61] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:01:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 4989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:01:18.765793 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b34a5eef-9371-4248-8bc1-39808c39f6f7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:18.766415 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b34a5eef-9371-4248-8bc1-39808c39f6f7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:18.789754 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b34a5eef-9371-4248-8bc1-39808c39f6f7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:18.790182 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b34a5eef-9371-4248-8bc1-39808c39f6f7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:18.792329 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b34a5eef-9371-4248-8bc1-39808c39f6f7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:18.793019 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b34a5eef-9371-4248-8bc1-39808c39f6f7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:18.934915 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c3949532-c4e7-4064-9cd5-19a17efcd6f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:18.948166 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c3949532-c4e7-4064-9cd5-19a17efcd6f6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1280 microversion: 2.1 time: 0.483788 Jun 23 16:01:18.967700 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 37/62] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:18 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1280 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:18.995325 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-87c1a979-d600-4c97-bd3c-de4172963ea6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:18.995956 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-87c1a979-d600-4c97-bd3c-de4172963ea6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:19.149786 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b34a5eef-9371-4248-8bc1-39808c39f6f7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:19.162079 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b34a5eef-9371-4248-8bc1-39808c39f6f7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:19.167160 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b34a5eef-9371-4248-8bc1-39808c39f6f7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:19.168341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b34a5eef-9371-4248-8bc1-39808c39f6f7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1339 microversion: 2.20 time: 0.429990 Jun 23 16:01:19.174913 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 26/63] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:18 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1339 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:19.479236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a3cf9d34-10aa-49d2-95bd-0921bae7481d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:19.480677 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a3cf9d34-10aa-49d2-95bd-0921bae7481d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:19.496181 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a3cf9d34-10aa-49d2-95bd-0921bae7481d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:19.497007 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a3cf9d34-10aa-49d2-95bd-0921bae7481d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:19.500782 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a3cf9d34-10aa-49d2-95bd-0921bae7481d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:19.501552 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a3cf9d34-10aa-49d2-95bd-0921bae7481d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:19.639256 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-87c1a979-d600-4c97-bd3c-de4172963ea6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:19.654356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-87c1a979-d600-4c97-bd3c-de4172963ea6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1242 microversion: 2.1 time: 0.683761 Jun 23 16:01:19.655740 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 38/64] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:18 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1242 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:19.988459 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d49d8f6e-4f75-4226-a51b-9628016f78f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:19.989771 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d49d8f6e-4f75-4226-a51b-9628016f78f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:20.005508 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d49d8f6e-4f75-4226-a51b-9628016f78f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:20.005986 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d49d8f6e-4f75-4226-a51b-9628016f78f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:20.009282 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d49d8f6e-4f75-4226-a51b-9628016f78f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:20.009755 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d49d8f6e-4f75-4226-a51b-9628016f78f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:20.564177 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d49d8f6e-4f75-4226-a51b-9628016f78f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:20.593251 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d49d8f6e-4f75-4226-a51b-9628016f78f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1280 microversion: 2.1 time: 0.603337 Jun 23 16:01:20.593964 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 39/65] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:19 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1280 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:20.627547 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c94f1893-3fcf-44cf-9c13-4076479e8b4e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:20.629020 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c94f1893-3fcf-44cf-9c13-4076479e8b4e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:20.673208 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c94f1893-3fcf-44cf-9c13-4076479e8b4e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:20.674010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c94f1893-3fcf-44cf-9c13-4076479e8b4e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:20.691219 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c94f1893-3fcf-44cf-9c13-4076479e8b4e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:20.692620 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c94f1893-3fcf-44cf-9c13-4076479e8b4e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:21.316891 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a3cf9d34-10aa-49d2-95bd-0921bae7481d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:21.331596 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a3cf9d34-10aa-49d2-95bd-0921bae7481d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 1.858333 Jun 23 16:01:21.339767 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 27/66] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:19 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:21.346734 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-262fbc13-2730-49c0-aaa3-2c4803718bdd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:21.352513 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-262fbc13-2730-49c0-aaa3-2c4803718bdd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:21.372355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-262fbc13-2730-49c0-aaa3-2c4803718bdd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:21.374115 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-262fbc13-2730-49c0-aaa3-2c4803718bdd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:21.377615 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-262fbc13-2730-49c0-aaa3-2c4803718bdd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:21.379351 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-262fbc13-2730-49c0-aaa3-2c4803718bdd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:21.814197 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-262fbc13-2730-49c0-aaa3-2c4803718bdd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:21.830404 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-262fbc13-2730-49c0-aaa3-2c4803718bdd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1312 microversion: 2.1 time: 0.489134 Jun 23 16:01:21.833646 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 28/67] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:21 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1312 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:21.936824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c94f1893-3fcf-44cf-9c13-4076479e8b4e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:21.957527 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c94f1893-3fcf-44cf-9c13-4076479e8b4e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:21.963385 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c94f1893-3fcf-44cf-9c13-4076479e8b4e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:21.970800 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c94f1893-3fcf-44cf-9c13-4076479e8b4e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1339 microversion: 2.20 time: 1.371963 Jun 23 16:01:21.976168 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 40/68] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:20 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1339 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:21.996683 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-77ae0c68-823b-4fb5-9b47-c3630656e3ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:21.997609 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-77ae0c68-823b-4fb5-9b47-c3630656e3ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:22.028119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77ae0c68-823b-4fb5-9b47-c3630656e3ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:22.031870 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77ae0c68-823b-4fb5-9b47-c3630656e3ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:22.035213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77ae0c68-823b-4fb5-9b47-c3630656e3ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:22.036088 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77ae0c68-823b-4fb5-9b47-c3630656e3ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:22.390342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-489e5bdd-68df-4b14-abcf-b7562d98ea7d req-fb754d33-247f-4e99-be67-f5b9cb9bf188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff2e14e-d713-4245-be6a-3055e546bd1d", "tag": "4432f611-e405-4a38-b98a-2d230d1bbc40"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:22.453092 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-489e5bdd-68df-4b14-abcf-b7562d98ea7d req-fb754d33-247f-4e99-be67-f5b9cb9bf188 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:22.456669 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-489e5bdd-68df-4b14-abcf-b7562d98ea7d req-fb754d33-247f-4e99-be67-f5b9cb9bf188 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:22.562145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-489e5bdd-68df-4b14-abcf-b7562d98ea7d req-fb754d33-247f-4e99-be67-f5b9cb9bf188 service nova] Creating event network-changed:4432f611-e405-4a38-b98a-2d230d1bbc40 for instance 0ff2e14e-d713-4245-be6a-3055e546bd1d on hv-cinder-83538 Jun 23 16:01:22.568145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-489e5bdd-68df-4b14-abcf-b7562d98ea7d req-fb754d33-247f-4e99-be67-f5b9cb9bf188 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117891) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 16:01:22.572542 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5357a5-7865-408b-9c6e-04a82c936baf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:22.575300 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5357a5-7865-408b-9c6e-04a82c936baf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:22.590219 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5357a5-7865-408b-9c6e-04a82c936baf None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:22.591366 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5357a5-7865-408b-9c6e-04a82c936baf None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:22.642914 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.compute.rpcapi [None req-5a5357a5-7865-408b-9c6e-04a82c936baf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 16:01:22.653120 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5357a5-7865-408b-9c6e-04a82c936baf None None] Releasing lock "compute-rpcapi-router" {{(pid=117891) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 16:01:22.729186 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5a5357a5-7865-408b-9c6e-04a82c936baf None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.892589 Jun 23 16:01:22.732139 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 29/69] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:22.738985 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-aa5901ca-7504-4eec-93a6-fbc0547beab9 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:22.743021 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-aa5901ca-7504-4eec-93a6-fbc0547beab9 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:22.785165 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa5901ca-7504-4eec-93a6-fbc0547beab9 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:22.786637 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa5901ca-7504-4eec-93a6-fbc0547beab9 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:22.787882 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa5901ca-7504-4eec-93a6-fbc0547beab9 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:22.793088 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aa5901ca-7504-4eec-93a6-fbc0547beab9 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:23.574006 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-77ae0c68-823b-4fb5-9b47-c3630656e3ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:23.593711 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-77ae0c68-823b-4fb5-9b47-c3630656e3ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 1.615670 Jun 23 16:01:23.594718 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 41/70] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:21 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 1618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:23.604481 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a1e571d9-af10-447f-9200-cc8037567be6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:23.606539 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a1e571d9-af10-447f-9200-cc8037567be6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:23.620418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1e571d9-af10-447f-9200-cc8037567be6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:23.620869 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1e571d9-af10-447f-9200-cc8037567be6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:23.621680 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1e571d9-af10-447f-9200-cc8037567be6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:23.622115 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1e571d9-af10-447f-9200-cc8037567be6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:23.694476 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-aa5901ca-7504-4eec-93a6-fbc0547beab9 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:23.709105 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-aa5901ca-7504-4eec-93a6-fbc0547beab9 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.974025 Jun 23 16:01:23.710518 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 30/71] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:22 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:23.724801 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-58d9a1af-729f-47dd-88ea-543f316457f1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:23.726245 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-58d9a1af-729f-47dd-88ea-543f316457f1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:23.745721 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-58d9a1af-729f-47dd-88ea-543f316457f1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:23.746439 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-58d9a1af-729f-47dd-88ea-543f316457f1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:23.747286 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-58d9a1af-729f-47dd-88ea-543f316457f1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:23.747730 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-58d9a1af-729f-47dd-88ea-543f316457f1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:23.898232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a1e571d9-af10-447f-9200-cc8037567be6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:23.917334 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a1e571d9-af10-447f-9200-cc8037567be6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1300 microversion: 2.1 time: 0.318899 Jun 23 16:01:23.920327 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 42/72] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:23 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1300 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:24.203904 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-58d9a1af-729f-47dd-88ea-543f316457f1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:24.217249 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-58d9a1af-729f-47dd-88ea-543f316457f1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:24.220643 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-58d9a1af-729f-47dd-88ea-543f316457f1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:24.221783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-58d9a1af-729f-47dd-88ea-543f316457f1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.507230 Jun 23 16:01:24.233044 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 31/73] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:23 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:24.613432 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d3db1778-e6ca-45b0-ac5f-8bd9f5fe66e6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:24.615261 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d3db1778-e6ca-45b0-ac5f-8bd9f5fe66e6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:24.624905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d3db1778-e6ca-45b0-ac5f-8bd9f5fe66e6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:24.629810 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d3db1778-e6ca-45b0-ac5f-8bd9f5fe66e6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:24.646184 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d3db1778-e6ca-45b0-ac5f-8bd9f5fe66e6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:24.647234 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d3db1778-e6ca-45b0-ac5f-8bd9f5fe66e6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:24.683296 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=85 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:24.707304 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:24.730821 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-45c3149d-1d72-47ea-aa96-ccafc32046ab tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:24.732149 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-45c3149d-1d72-47ea-aa96-ccafc32046ab tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:24.742582 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-45c3149d-1d72-47ea-aa96-ccafc32046ab tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:24.743109 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-45c3149d-1d72-47ea-aa96-ccafc32046ab tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:24.745165 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-45c3149d-1d72-47ea-aa96-ccafc32046ab tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:24.747868 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-45c3149d-1d72-47ea-aa96-ccafc32046ab tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:25.305393 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d3db1778-e6ca-45b0-ac5f-8bd9f5fe66e6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:25.322163 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d3db1778-e6ca-45b0-ac5f-8bd9f5fe66e6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.713583 Jun 23 16:01:25.323283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 43/74] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:24 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:25.339443 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-9d877272-a2cc-4be7-ac7f-ef8dd5e89173 req-f5a0bb28-3a8f-41d0-8f2d-ffb24a7bb23b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "777072f3-db6b-4c68-8fbb-e300170a00b8", "tag": "5a29fed5-a9ab-4a4e-801f-a191224a8a53"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:25.366058 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-9d877272-a2cc-4be7-ac7f-ef8dd5e89173 req-f5a0bb28-3a8f-41d0-8f2d-ffb24a7bb23b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:25.367263 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-9d877272-a2cc-4be7-ac7f-ef8dd5e89173 req-f5a0bb28-3a8f-41d0-8f2d-ffb24a7bb23b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:25.426663 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-9d877272-a2cc-4be7-ac7f-ef8dd5e89173 req-f5a0bb28-3a8f-41d0-8f2d-ffb24a7bb23b service nova] Creating event network-changed:5a29fed5-a9ab-4a4e-801f-a191224a8a53 for instance 777072f3-db6b-4c68-8fbb-e300170a00b8 on hv-cinder-83538 Jun 23 16:01:25.427225 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-9d877272-a2cc-4be7-ac7f-ef8dd5e89173 req-f5a0bb28-3a8f-41d0-8f2d-ffb24a7bb23b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 16:01:25.432175 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5f554605-8d5c-46a1-b20a-a3b770e1f17e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:25.435026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5f554605-8d5c-46a1-b20a-a3b770e1f17e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:25.436209 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5f554605-8d5c-46a1-b20a-a3b770e1f17e None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:25.436402 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5f554605-8d5c-46a1-b20a-a3b770e1f17e None None] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:25.471464 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.compute.rpcapi [None req-5f554605-8d5c-46a1-b20a-a3b770e1f17e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 16:01:25.474568 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5f554605-8d5c-46a1-b20a-a3b770e1f17e None None] Releasing lock "compute-rpcapi-router" {{(pid=117890) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 16:01:25.505295 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5f554605-8d5c-46a1-b20a-a3b770e1f17e None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179974 Jun 23 16:01:25.506467 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 44/75] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:25.513521 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3bdcd572-0db7-4f37-b31e-3e81e91c0dd0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:25.514623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3bdcd572-0db7-4f37-b31e-3e81e91c0dd0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:25.533901 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3bdcd572-0db7-4f37-b31e-3e81e91c0dd0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:25.534366 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3bdcd572-0db7-4f37-b31e-3e81e91c0dd0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:25.535193 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3bdcd572-0db7-4f37-b31e-3e81e91c0dd0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:25.535632 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3bdcd572-0db7-4f37-b31e-3e81e91c0dd0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:25.785935 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3bdcd572-0db7-4f37-b31e-3e81e91c0dd0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:25.798414 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3bdcd572-0db7-4f37-b31e-3e81e91c0dd0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1300 microversion: 2.1 time: 0.290454 Jun 23 16:01:25.800863 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 45/76] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:25 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:25.813177 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7c672125-5fb2-48f0-927d-3f068ab99459 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:25.814175 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7c672125-5fb2-48f0-927d-3f068ab99459 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:25.831935 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c672125-5fb2-48f0-927d-3f068ab99459 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:25.832724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c672125-5fb2-48f0-927d-3f068ab99459 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:25.834976 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c672125-5fb2-48f0-927d-3f068ab99459 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:25.836431 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c672125-5fb2-48f0-927d-3f068ab99459 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:25.895371 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-45c3149d-1d72-47ea-aa96-ccafc32046ab tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:25.907156 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-45c3149d-1d72-47ea-aa96-ccafc32046ab tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 1.181575 Jun 23 16:01:25.915123 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 32/77] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:24 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:26.342104 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ed9ec032-2c41-49c9-bdf2-a0767edf4745 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:26.342815 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ed9ec032-2c41-49c9-bdf2-a0767edf4745 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:26.358399 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ed9ec032-2c41-49c9-bdf2-a0767edf4745 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:26.359265 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ed9ec032-2c41-49c9-bdf2-a0767edf4745 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:26.362133 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ed9ec032-2c41-49c9-bdf2-a0767edf4745 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:26.363348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ed9ec032-2c41-49c9-bdf2-a0767edf4745 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:26.770757 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c672125-5fb2-48f0-927d-3f068ab99459 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:26.783420 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c672125-5fb2-48f0-927d-3f068ab99459 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:26.785535 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c672125-5fb2-48f0-927d-3f068ab99459 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:26.787276 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7c672125-5fb2-48f0-927d-3f068ab99459 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.985045 Jun 23 16:01:26.789171 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 46/78] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:25 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:26.865522 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ed9ec032-2c41-49c9-bdf2-a0767edf4745 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:26.878864 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ed9ec032-2c41-49c9-bdf2-a0767edf4745 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.539347 Jun 23 16:01:26.879795 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 33/79] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:26 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:26.888472 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-075905a2-600c-4807-aabc-b8d1f60e6bf8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:26.891444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-075905a2-600c-4807-aabc-b8d1f60e6bf8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:26.901104 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-075905a2-600c-4807-aabc-b8d1f60e6bf8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:26.901772 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-075905a2-600c-4807-aabc-b8d1f60e6bf8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:26.903200 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-075905a2-600c-4807-aabc-b8d1f60e6bf8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:26.903975 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-075905a2-600c-4807-aabc-b8d1f60e6bf8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:27.253308 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-075905a2-600c-4807-aabc-b8d1f60e6bf8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:27.294896 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-075905a2-600c-4807-aabc-b8d1f60e6bf8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.410357 Jun 23 16:01:27.298335 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 34/80] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:26 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:27.316467 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1cb4bc5e-f504-4d63-ace1-e13ac56a5d23 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:27.324072 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1cb4bc5e-f504-4d63-ace1-e13ac56a5d23 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:27.339739 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1cb4bc5e-f504-4d63-ace1-e13ac56a5d23 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:27.340529 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1cb4bc5e-f504-4d63-ace1-e13ac56a5d23 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:27.341894 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1cb4bc5e-f504-4d63-ace1-e13ac56a5d23 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:27.342638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1cb4bc5e-f504-4d63-ace1-e13ac56a5d23 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:27.382043 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-c0bb2a36-0d94-495f-97d7-01a845a5f1bf req-19b376ba-4066-4698-aa9d-2b769fb14465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "030dcf0e-dfb9-4e58-a617-f6330ae03134", "tag": "492927a9-54a0-4835-8cdd-c1cd95b4eac3"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:27.425106 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-c0bb2a36-0d94-495f-97d7-01a845a5f1bf req-19b376ba-4066-4698-aa9d-2b769fb14465 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:27.432080 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-c0bb2a36-0d94-495f-97d7-01a845a5f1bf req-19b376ba-4066-4698-aa9d-2b769fb14465 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:27.481356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-c0bb2a36-0d94-495f-97d7-01a845a5f1bf req-19b376ba-4066-4698-aa9d-2b769fb14465 service nova] Creating event network-changed:492927a9-54a0-4835-8cdd-c1cd95b4eac3 for instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 on hv-cinder-83538 Jun 23 16:01:27.500181 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-c0bb2a36-0d94-495f-97d7-01a845a5f1bf req-19b376ba-4066-4698-aa9d-2b769fb14465 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.709405 Jun 23 16:01:27.501366 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 47/81] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:27.681736 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1cb4bc5e-f504-4d63-ace1-e13ac56a5d23 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:27.690217 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1cb4bc5e-f504-4d63-ace1-e13ac56a5d23 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.390189 Jun 23 16:01:27.694560 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 35/82] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:27 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:27.809114 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cd6d5eb3-9fc7-4352-99b1-6d4bbe50d803 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:27.810119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cd6d5eb3-9fc7-4352-99b1-6d4bbe50d803 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:27.818073 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd6d5eb3-9fc7-4352-99b1-6d4bbe50d803 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:27.818896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd6d5eb3-9fc7-4352-99b1-6d4bbe50d803 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:27.822455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd6d5eb3-9fc7-4352-99b1-6d4bbe50d803 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:27.824648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cd6d5eb3-9fc7-4352-99b1-6d4bbe50d803 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:27.896257 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b10e81f8-c622-43da-a69b-43f41c580df6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:27.896869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b10e81f8-c622-43da-a69b-43f41c580df6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:27.914239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b10e81f8-c622-43da-a69b-43f41c580df6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:27.914833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b10e81f8-c622-43da-a69b-43f41c580df6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:27.916031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b10e81f8-c622-43da-a69b-43f41c580df6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:27.916464 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b10e81f8-c622-43da-a69b-43f41c580df6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:27.922759 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:28.131806 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cd6d5eb3-9fc7-4352-99b1-6d4bbe50d803 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:28.142738 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cd6d5eb3-9fc7-4352-99b1-6d4bbe50d803 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:28.149026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cd6d5eb3-9fc7-4352-99b1-6d4bbe50d803 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:28.151393 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cd6d5eb3-9fc7-4352-99b1-6d4bbe50d803 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.347362 Jun 23 16:01:28.155300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 48/83] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:27 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:28.175373 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b10e81f8-c622-43da-a69b-43f41c580df6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:28.185161 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b10e81f8-c622-43da-a69b-43f41c580df6 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.292321 Jun 23 16:01:28.186362 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 36/84] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:27 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:28.327588 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-52fba11a-ec42-4fc0-87f3-e6ff106ee05a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:28.329376 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-52fba11a-ec42-4fc0-87f3-e6ff106ee05a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:28.340647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-52fba11a-ec42-4fc0-87f3-e6ff106ee05a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:28.344244 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-52fba11a-ec42-4fc0-87f3-e6ff106ee05a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:28.345608 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-52fba11a-ec42-4fc0-87f3-e6ff106ee05a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:28.346891 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-52fba11a-ec42-4fc0-87f3-e6ff106ee05a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:28.562548 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-52fba11a-ec42-4fc0-87f3-e6ff106ee05a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:28.574147 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-52fba11a-ec42-4fc0-87f3-e6ff106ee05a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.252563 Jun 23 16:01:28.586424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 49/85] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:28 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:28.710260 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ecef9fca-f0d0-4ae2-9e1e-060f6af3ac9f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:28.710495 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ecef9fca-f0d0-4ae2-9e1e-060f6af3ac9f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:28.713047 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:28.723503 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ecef9fca-f0d0-4ae2-9e1e-060f6af3ac9f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:28.727808 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ecef9fca-f0d0-4ae2-9e1e-060f6af3ac9f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:28.728793 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ecef9fca-f0d0-4ae2-9e1e-060f6af3ac9f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:28.729299 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ecef9fca-f0d0-4ae2-9e1e-060f6af3ac9f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:28.955576 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ecef9fca-f0d0-4ae2-9e1e-060f6af3ac9f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:28.966150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ecef9fca-f0d0-4ae2-9e1e-060f6af3ac9f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.260344 Jun 23 16:01:28.967145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 37/86] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:28 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:29.175059 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4d3c0688-86ea-45ef-b36f-2c601eaadfb9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:29.176769 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4d3c0688-86ea-45ef-b36f-2c601eaadfb9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:29.188332 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d3c0688-86ea-45ef-b36f-2c601eaadfb9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:29.189264 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d3c0688-86ea-45ef-b36f-2c601eaadfb9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:29.190404 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d3c0688-86ea-45ef-b36f-2c601eaadfb9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:29.191477 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d3c0688-86ea-45ef-b36f-2c601eaadfb9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:29.204759 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1d17119c-7bcb-4f64-b7d1-076643d3c174 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:29.206100 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1d17119c-7bcb-4f64-b7d1-076643d3c174 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:29.217844 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d17119c-7bcb-4f64-b7d1-076643d3c174 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:29.222118 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d17119c-7bcb-4f64-b7d1-076643d3c174 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:29.223352 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d17119c-7bcb-4f64-b7d1-076643d3c174 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:29.226343 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d17119c-7bcb-4f64-b7d1-076643d3c174 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:29.651208 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=34 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:29.840748 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d3c0688-86ea-45ef-b36f-2c601eaadfb9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:29.854438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d3c0688-86ea-45ef-b36f-2c601eaadfb9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:29.859889 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d3c0688-86ea-45ef-b36f-2c601eaadfb9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:29.863339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4d3c0688-86ea-45ef-b36f-2c601eaadfb9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.696189 Jun 23 16:01:29.877988 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 50/87] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:29 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:29.883294 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-83cd6ea4-c18b-4d49-87e2-a126dd5ae07a req-3a730ec7-615e-473e-8628-d9b19ec41936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14021a2e-8af8-4292-996e-ea87ff7752e0", "tag": "15db635b-5851-4528-8f58-f9ba091f51a6"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:29.894496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-83cd6ea4-c18b-4d49-87e2-a126dd5ae07a req-3a730ec7-615e-473e-8628-d9b19ec41936 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:29.895603 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-83cd6ea4-c18b-4d49-87e2-a126dd5ae07a req-3a730ec7-615e-473e-8628-d9b19ec41936 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:29.909311 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-83cd6ea4-c18b-4d49-87e2-a126dd5ae07a req-3a730ec7-615e-473e-8628-d9b19ec41936 service nova] Creating event network-changed:15db635b-5851-4528-8f58-f9ba091f51a6 for instance 14021a2e-8af8-4292-996e-ea87ff7752e0 on hv-cinder-83538 Jun 23 16:01:29.916727 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-83cd6ea4-c18b-4d49-87e2-a126dd5ae07a req-3a730ec7-615e-473e-8628-d9b19ec41936 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035483 Jun 23 16:01:29.917438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 51/88] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:29.924742 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-90ea8a66-4f68-49a2-9067-b9e60c3a87fc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:29.925673 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-90ea8a66-4f68-49a2-9067-b9e60c3a87fc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:29.933249 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-90ea8a66-4f68-49a2-9067-b9e60c3a87fc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:29.933949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-90ea8a66-4f68-49a2-9067-b9e60c3a87fc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:29.934765 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-90ea8a66-4f68-49a2-9067-b9e60c3a87fc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:29.935282 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-90ea8a66-4f68-49a2-9067-b9e60c3a87fc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:30.206056 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1d17119c-7bcb-4f64-b7d1-076643d3c174 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:30.215414 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1d17119c-7bcb-4f64-b7d1-076643d3c174 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 1.016150 Jun 23 16:01:30.219687 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 38/89] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:29 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:30.236976 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dfe5c23e-8823-435d-a726-2685b0a4d556 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:30.238927 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dfe5c23e-8823-435d-a726-2685b0a4d556 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:30.258377 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dfe5c23e-8823-435d-a726-2685b0a4d556 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:30.260412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dfe5c23e-8823-435d-a726-2685b0a4d556 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:30.269182 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dfe5c23e-8823-435d-a726-2685b0a4d556 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:30.269182 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dfe5c23e-8823-435d-a726-2685b0a4d556 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:30.332384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-90ea8a66-4f68-49a2-9067-b9e60c3a87fc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:30.341177 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-90ea8a66-4f68-49a2-9067-b9e60c3a87fc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.421777 Jun 23 16:01:30.342239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 52/90] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:29 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:30.887054 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0939cade-0516-44d2-bad0-9799b0de6ac2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:30.888500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0939cade-0516-44d2-bad0-9799b0de6ac2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:30.905596 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0939cade-0516-44d2-bad0-9799b0de6ac2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:30.906285 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0939cade-0516-44d2-bad0-9799b0de6ac2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:30.907307 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0939cade-0516-44d2-bad0-9799b0de6ac2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:30.908693 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0939cade-0516-44d2-bad0-9799b0de6ac2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:30.926181 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dfe5c23e-8823-435d-a726-2685b0a4d556 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:30.934459 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dfe5c23e-8823-435d-a726-2685b0a4d556 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.711444 Jun 23 16:01:30.939620 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 39/91] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:30 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:31.159333 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0939cade-0516-44d2-bad0-9799b0de6ac2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:31.176447 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0939cade-0516-44d2-bad0-9799b0de6ac2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:31.179585 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0939cade-0516-44d2-bad0-9799b0de6ac2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:31.182768 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0939cade-0516-44d2-bad0-9799b0de6ac2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.300614 Jun 23 16:01:31.184057 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 53/92] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:30 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:01:31.238815 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-95a825d5-25b2-4df1-a99b-8b52ffc1d7f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:31.239635 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-95a825d5-25b2-4df1-a99b-8b52ffc1d7f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:31.254319 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95a825d5-25b2-4df1-a99b-8b52ffc1d7f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:31.255676 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95a825d5-25b2-4df1-a99b-8b52ffc1d7f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:31.259752 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95a825d5-25b2-4df1-a99b-8b52ffc1d7f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:31.261926 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95a825d5-25b2-4df1-a99b-8b52ffc1d7f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:31.370669 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2e82df12-c105-4e64-a7fd-f6867f416940 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:31.373474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2e82df12-c105-4e64-a7fd-f6867f416940 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:31.409545 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e82df12-c105-4e64-a7fd-f6867f416940 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:31.415411 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e82df12-c105-4e64-a7fd-f6867f416940 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:31.417240 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e82df12-c105-4e64-a7fd-f6867f416940 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:31.418292 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e82df12-c105-4e64-a7fd-f6867f416940 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:31.793673 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-95a825d5-25b2-4df1-a99b-8b52ffc1d7f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:31.835620 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-95a825d5-25b2-4df1-a99b-8b52ffc1d7f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.600874 Jun 23 16:01:31.836845 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 40/93] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:31 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:31.845577 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-bc5e9327-ca6a-4bfc-b967-e84d5feb6a3a req-1b3ac029-c6bb-4cfc-a42e-7d32ba1c9d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa6e984-d2b4-48ea-b887-250c0935b0be", "tag": "ab7781e0-6518-45fd-8136-cb944ebb585a"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:31.859134 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2e82df12-c105-4e64-a7fd-f6867f416940 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:31.860224 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-bc5e9327-ca6a-4bfc-b967-e84d5feb6a3a req-1b3ac029-c6bb-4cfc-a42e-7d32ba1c9d90 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:31.860875 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-bc5e9327-ca6a-4bfc-b967-e84d5feb6a3a req-1b3ac029-c6bb-4cfc-a42e-7d32ba1c9d90 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:31.872494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2e82df12-c105-4e64-a7fd-f6867f416940 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.513987 Jun 23 16:01:31.873445 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 54/94] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:31 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:31.886339 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-bc5e9327-ca6a-4bfc-b967-e84d5feb6a3a req-1b3ac029-c6bb-4cfc-a42e-7d32ba1c9d90 service nova] Creating event network-changed:ab7781e0-6518-45fd-8136-cb944ebb585a for instance 0aa6e984-d2b4-48ea-b887-250c0935b0be on hv-cinder-83538 Jun 23 16:01:31.908518 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-bc5e9327-ca6a-4bfc-b967-e84d5feb6a3a req-1b3ac029-c6bb-4cfc-a42e-7d32ba1c9d90 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068729 Jun 23 16:01:31.909140 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 41/95] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:31.973611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-44e9f134-2839-4319-9a90-19b81fcb0cbd tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:31.973611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-44e9f134-2839-4319-9a90-19b81fcb0cbd tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:31.990909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44e9f134-2839-4319-9a90-19b81fcb0cbd tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:31.995496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44e9f134-2839-4319-9a90-19b81fcb0cbd tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:31.997304 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44e9f134-2839-4319-9a90-19b81fcb0cbd tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:31.997881 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44e9f134-2839-4319-9a90-19b81fcb0cbd tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:32.212632 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f1cef744-f0bc-4f55-9011-54616c1d1c85 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:32.213296 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f1cef744-f0bc-4f55-9011-54616c1d1c85 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:32.224790 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1cef744-f0bc-4f55-9011-54616c1d1c85 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:32.225673 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1cef744-f0bc-4f55-9011-54616c1d1c85 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:32.227122 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1cef744-f0bc-4f55-9011-54616c1d1c85 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:32.228099 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1cef744-f0bc-4f55-9011-54616c1d1c85 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:32.292794 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-44e9f134-2839-4319-9a90-19b81fcb0cbd tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:32.306788 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-44e9f134-2839-4319-9a90-19b81fcb0cbd tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.349443 Jun 23 16:01:32.307795 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 55/96] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:31 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:32.413840 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f1cef744-f0bc-4f55-9011-54616c1d1c85 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:32.426809 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f1cef744-f0bc-4f55-9011-54616c1d1c85 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:32.429722 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f1cef744-f0bc-4f55-9011-54616c1d1c85 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:32.433233 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f1cef744-f0bc-4f55-9011-54616c1d1c85 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.225884 Jun 23 16:01:32.434771 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 42/97] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:32 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:32.860001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a30fd7d9-83e7-449f-9442-d959c9b45afd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:32.861528 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a30fd7d9-83e7-449f-9442-d959c9b45afd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:32.871958 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a30fd7d9-83e7-449f-9442-d959c9b45afd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:32.872869 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a30fd7d9-83e7-449f-9442-d959c9b45afd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:32.874315 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a30fd7d9-83e7-449f-9442-d959c9b45afd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:32.875130 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a30fd7d9-83e7-449f-9442-d959c9b45afd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:32.908644 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4885308b-ac02-46e8-b370-2f5fd74802da tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:32.909835 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4885308b-ac02-46e8-b370-2f5fd74802da tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:32.921956 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=4 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:32.926441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4885308b-ac02-46e8-b370-2f5fd74802da tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:32.927748 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4885308b-ac02-46e8-b370-2f5fd74802da tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:32.930317 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4885308b-ac02-46e8-b370-2f5fd74802da tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:32.931766 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4885308b-ac02-46e8-b370-2f5fd74802da tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:33.152059 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4885308b-ac02-46e8-b370-2f5fd74802da tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:33.163235 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4885308b-ac02-46e8-b370-2f5fd74802da tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.262054 Jun 23 16:01:33.164897 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 43/98] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:32 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:33.328755 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6b3d96d7-95e0-44c0-aea6-8e0c1e1ba63a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:33.329928 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6b3d96d7-95e0-44c0-aea6-8e0c1e1ba63a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:33.343690 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6b3d96d7-95e0-44c0-aea6-8e0c1e1ba63a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:33.345004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6b3d96d7-95e0-44c0-aea6-8e0c1e1ba63a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:33.347417 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6b3d96d7-95e0-44c0-aea6-8e0c1e1ba63a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:33.348538 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6b3d96d7-95e0-44c0-aea6-8e0c1e1ba63a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:33.454107 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a30fd7d9-83e7-449f-9442-d959c9b45afd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:33.465765 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a30fd7d9-83e7-449f-9442-d959c9b45afd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.614114 Jun 23 16:01:33.469569 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 56/99] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:32 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:33.478923 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-262c56c6-e363-4628-b426-49f35a0f8193 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:33.481928 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-262c56c6-e363-4628-b426-49f35a0f8193 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:33.503766 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-262c56c6-e363-4628-b426-49f35a0f8193 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:33.505547 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-262c56c6-e363-4628-b426-49f35a0f8193 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:33.508485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-262c56c6-e363-4628-b426-49f35a0f8193 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:33.509556 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-262c56c6-e363-4628-b426-49f35a0f8193 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:33.687870 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6b3d96d7-95e0-44c0-aea6-8e0c1e1ba63a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:33.704161 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6b3d96d7-95e0-44c0-aea6-8e0c1e1ba63a tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.382473 Jun 23 16:01:33.706090 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 44/100] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:33 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:33.844938 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-262c56c6-e363-4628-b426-49f35a0f8193 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:33.856033 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-262c56c6-e363-4628-b426-49f35a0f8193 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:33.858384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-262c56c6-e363-4628-b426-49f35a0f8193 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:33.859791 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-262c56c6-e363-4628-b426-49f35a0f8193 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.387909 Jun 23 16:01:33.861115 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 57/101] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:33 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:34.182894 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2eee0e0d-a289-4709-9e58-ab7b58c9fc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:34.184006 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2eee0e0d-a289-4709-9e58-ab7b58c9fc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:34.191356 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2eee0e0d-a289-4709-9e58-ab7b58c9fc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:34.191801 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2eee0e0d-a289-4709-9e58-ab7b58c9fc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:34.192592 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2eee0e0d-a289-4709-9e58-ab7b58c9fc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:34.193023 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2eee0e0d-a289-4709-9e58-ab7b58c9fc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:34.506982 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-37ce33e0-e76a-4581-87f0-d36598476786 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:34.508110 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-37ce33e0-e76a-4581-87f0-d36598476786 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:34.529820 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-37ce33e0-e76a-4581-87f0-d36598476786 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:34.530638 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-37ce33e0-e76a-4581-87f0-d36598476786 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:34.531576 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-37ce33e0-e76a-4581-87f0-d36598476786 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:34.534162 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-37ce33e0-e76a-4581-87f0-d36598476786 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:34.614037 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2eee0e0d-a289-4709-9e58-ab7b58c9fc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:34.641172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2eee0e0d-a289-4709-9e58-ab7b58c9fc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.458545 Jun 23 16:01:34.642838 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 45/102] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:34 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:34.724869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6d19eddd-26b9-4e11-aa3c-8eae7e9e6140 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:34.726116 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6d19eddd-26b9-4e11-aa3c-8eae7e9e6140 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:34.744037 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d19eddd-26b9-4e11-aa3c-8eae7e9e6140 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:34.744711 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d19eddd-26b9-4e11-aa3c-8eae7e9e6140 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:34.745726 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d19eddd-26b9-4e11-aa3c-8eae7e9e6140 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:34.746321 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d19eddd-26b9-4e11-aa3c-8eae7e9e6140 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:34.822142 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-37ce33e0-e76a-4581-87f0-d36598476786 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:34.831331 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-37ce33e0-e76a-4581-87f0-d36598476786 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.329792 Jun 23 16:01:34.832645 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 58/103] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:34 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:34.887851 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4d56a7c0-9c05-43bd-a37b-c52e98e90178 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:34.889440 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4d56a7c0-9c05-43bd-a37b-c52e98e90178 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:34.900972 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d56a7c0-9c05-43bd-a37b-c52e98e90178 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:34.901650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d56a7c0-9c05-43bd-a37b-c52e98e90178 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:34.902761 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d56a7c0-9c05-43bd-a37b-c52e98e90178 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:34.903457 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d56a7c0-9c05-43bd-a37b-c52e98e90178 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:35.064360 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6d19eddd-26b9-4e11-aa3c-8eae7e9e6140 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:35.077962 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6d19eddd-26b9-4e11-aa3c-8eae7e9e6140 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.358257 Jun 23 16:01:35.078609 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 46/104] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:34 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:35.154352 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d56a7c0-9c05-43bd-a37b-c52e98e90178 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:35.165657 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d56a7c0-9c05-43bd-a37b-c52e98e90178 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:35.176632 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d56a7c0-9c05-43bd-a37b-c52e98e90178 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:35.176632 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4d56a7c0-9c05-43bd-a37b-c52e98e90178 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.286927 Jun 23 16:01:35.176632 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 59/105] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:34 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:01:35.668989 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-72ce4835-e892-4078-ad43-cde0dbce85e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:35.669653 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-72ce4835-e892-4078-ad43-cde0dbce85e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:35.676262 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-72ce4835-e892-4078-ad43-cde0dbce85e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:35.676892 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-72ce4835-e892-4078-ad43-cde0dbce85e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:35.677951 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-72ce4835-e892-4078-ad43-cde0dbce85e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:35.678627 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-72ce4835-e892-4078-ad43-cde0dbce85e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:35.858247 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a74a2046-e56e-4be0-9e50-0888395091ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:35.859469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a74a2046-e56e-4be0-9e50-0888395091ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:35.862001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:35.876635 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a74a2046-e56e-4be0-9e50-0888395091ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:35.880172 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a74a2046-e56e-4be0-9e50-0888395091ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:35.881269 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a74a2046-e56e-4be0-9e50-0888395091ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:35.881882 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a74a2046-e56e-4be0-9e50-0888395091ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:35.938572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-72ce4835-e892-4078-ad43-cde0dbce85e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:35.949808 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-72ce4835-e892-4078-ad43-cde0dbce85e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.285184 Jun 23 16:01:35.951657 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 47/106] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:35 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:36.077972 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a74a2046-e56e-4be0-9e50-0888395091ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:36.086484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a74a2046-e56e-4be0-9e50-0888395091ed tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.232110 Jun 23 16:01:36.087448 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 60/107] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:35 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:36.096347 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-392db3b8-44f6-4469-bbeb-8777799f7c4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:36.097312 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-392db3b8-44f6-4469-bbeb-8777799f7c4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:36.105039 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-392db3b8-44f6-4469-bbeb-8777799f7c4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:36.105986 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-392db3b8-44f6-4469-bbeb-8777799f7c4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:36.106960 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-392db3b8-44f6-4469-bbeb-8777799f7c4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:36.107631 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-392db3b8-44f6-4469-bbeb-8777799f7c4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:36.188732 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9d15f82f-ba90-4d44-8512-81f9e7a903df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:36.189221 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9d15f82f-ba90-4d44-8512-81f9e7a903df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:36.199050 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9d15f82f-ba90-4d44-8512-81f9e7a903df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:36.199812 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9d15f82f-ba90-4d44-8512-81f9e7a903df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:36.200956 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9d15f82f-ba90-4d44-8512-81f9e7a903df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:36.201722 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9d15f82f-ba90-4d44-8512-81f9e7a903df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:36.236194 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:36.377871 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-392db3b8-44f6-4469-bbeb-8777799f7c4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:36.387589 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-392db3b8-44f6-4469-bbeb-8777799f7c4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.295888 Jun 23 16:01:36.398370 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 48/108] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:36 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:36.534297 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9d15f82f-ba90-4d44-8512-81f9e7a903df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:36.548480 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9d15f82f-ba90-4d44-8512-81f9e7a903df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:36.551048 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9d15f82f-ba90-4d44-8512-81f9e7a903df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:36.557488 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9d15f82f-ba90-4d44-8512-81f9e7a903df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.367759 Jun 23 16:01:36.561692 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 61/109] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:36 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:36.981036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-31437a6b-4c2b-4530-9793-aaab36a4e79c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:36.982229 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-31437a6b-4c2b-4530-9793-aaab36a4e79c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:36.992530 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31437a6b-4c2b-4530-9793-aaab36a4e79c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:36.993590 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31437a6b-4c2b-4530-9793-aaab36a4e79c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:36.995461 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31437a6b-4c2b-4530-9793-aaab36a4e79c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:36.996472 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31437a6b-4c2b-4530-9793-aaab36a4e79c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:37.107833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cfbd2037-5d04-47c7-b1c1-84c4a7ec6514 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:37.108517 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cfbd2037-5d04-47c7-b1c1-84c4a7ec6514 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:37.117726 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cfbd2037-5d04-47c7-b1c1-84c4a7ec6514 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:37.121446 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cfbd2037-5d04-47c7-b1c1-84c4a7ec6514 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:37.122340 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cfbd2037-5d04-47c7-b1c1-84c4a7ec6514 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:37.123096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cfbd2037-5d04-47c7-b1c1-84c4a7ec6514 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:37.326308 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-31437a6b-4c2b-4530-9793-aaab36a4e79c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:37.344799 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-31437a6b-4c2b-4530-9793-aaab36a4e79c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.370566 Jun 23 16:01:37.362262 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 49/110] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:36 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:37.407555 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4f1867d4-b701-40cf-85b1-fd44e104a27b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:37.408227 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4f1867d4-b701-40cf-85b1-fd44e104a27b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:37.416626 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f1867d4-b701-40cf-85b1-fd44e104a27b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:37.417383 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f1867d4-b701-40cf-85b1-fd44e104a27b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:37.418495 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f1867d4-b701-40cf-85b1-fd44e104a27b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:37.419170 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f1867d4-b701-40cf-85b1-fd44e104a27b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:37.447370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cfbd2037-5d04-47c7-b1c1-84c4a7ec6514 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:37.458330 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cfbd2037-5d04-47c7-b1c1-84c4a7ec6514 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.357929 Jun 23 16:01:37.470116 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 62/111] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:37 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:37.587053 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a1c7f521-adb7-43fe-a285-8c0f0becadfb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:37.587689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a1c7f521-adb7-43fe-a285-8c0f0becadfb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:37.595074 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1c7f521-adb7-43fe-a285-8c0f0becadfb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:37.595522 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1c7f521-adb7-43fe-a285-8c0f0becadfb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:37.596484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1c7f521-adb7-43fe-a285-8c0f0becadfb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:37.597217 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a1c7f521-adb7-43fe-a285-8c0f0becadfb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:37.617903 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4f1867d4-b701-40cf-85b1-fd44e104a27b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:37.631968 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4f1867d4-b701-40cf-85b1-fd44e104a27b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.229369 Jun 23 16:01:37.634135 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 50/112] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:37 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:37.818248 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a1c7f521-adb7-43fe-a285-8c0f0becadfb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:37.834992 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a1c7f521-adb7-43fe-a285-8c0f0becadfb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:37.840818 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a1c7f521-adb7-43fe-a285-8c0f0becadfb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:37.844156 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a1c7f521-adb7-43fe-a285-8c0f0becadfb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.261608 Jun 23 16:01:37.845760 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 63/113] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:37 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:01:38.378980 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e7c6b99e-19b1-49c8-8ad8-33557a2d11b0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:38.379657 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e7c6b99e-19b1-49c8-8ad8-33557a2d11b0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:38.388189 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e7c6b99e-19b1-49c8-8ad8-33557a2d11b0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:38.388633 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e7c6b99e-19b1-49c8-8ad8-33557a2d11b0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:38.389680 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e7c6b99e-19b1-49c8-8ad8-33557a2d11b0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:38.390381 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e7c6b99e-19b1-49c8-8ad8-33557a2d11b0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:38.484078 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-59537bed-9311-43d4-9d47-362db64f273f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:38.486124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-59537bed-9311-43d4-9d47-362db64f273f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:38.509658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59537bed-9311-43d4-9d47-362db64f273f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:38.514116 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59537bed-9311-43d4-9d47-362db64f273f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:38.515559 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59537bed-9311-43d4-9d47-362db64f273f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:38.518529 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59537bed-9311-43d4-9d47-362db64f273f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:38.579179 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e7c6b99e-19b1-49c8-8ad8-33557a2d11b0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:38.599633 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e7c6b99e-19b1-49c8-8ad8-33557a2d11b0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.218460 Jun 23 16:01:38.600763 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 51/114] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:38 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:38.661522 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-99e79367-e0d7-40ec-bdec-b8b58d4d64c2 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:38.663490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-99e79367-e0d7-40ec-bdec-b8b58d4d64c2 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:38.671504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99e79367-e0d7-40ec-bdec-b8b58d4d64c2 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:38.672122 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99e79367-e0d7-40ec-bdec-b8b58d4d64c2 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:38.674634 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99e79367-e0d7-40ec-bdec-b8b58d4d64c2 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:38.675266 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-99e79367-e0d7-40ec-bdec-b8b58d4d64c2 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:38.811621 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-59537bed-9311-43d4-9d47-362db64f273f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:38.832055 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-59537bed-9311-43d4-9d47-362db64f273f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.354452 Jun 23 16:01:38.850989 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 64/115] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:38 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:38.851220 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-99e79367-e0d7-40ec-bdec-b8b58d4d64c2 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:38.862920 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-99e79367-e0d7-40ec-bdec-b8b58d4d64c2 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.205479 Jun 23 16:01:38.863906 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 52/116] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:38 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:38.875192 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1492a7ec-f2f6-4911-9785-ba1b99691d4f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:38.876317 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1492a7ec-f2f6-4911-9785-ba1b99691d4f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:38.884228 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1492a7ec-f2f6-4911-9785-ba1b99691d4f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:38.884678 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1492a7ec-f2f6-4911-9785-ba1b99691d4f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:38.885791 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1492a7ec-f2f6-4911-9785-ba1b99691d4f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:38.886235 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1492a7ec-f2f6-4911-9785-ba1b99691d4f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:39.082338 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1492a7ec-f2f6-4911-9785-ba1b99691d4f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:39.091658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1492a7ec-f2f6-4911-9785-ba1b99691d4f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:39.093603 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1492a7ec-f2f6-4911-9785-ba1b99691d4f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:39.095144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1492a7ec-f2f6-4911-9785-ba1b99691d4f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.230358 Jun 23 16:01:39.103873 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 65/117] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:38 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:01:39.642160 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1c09ea14-a446-4f07-8830-bc976b3c15a2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:39.643225 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1c09ea14-a446-4f07-8830-bc976b3c15a2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:39.656820 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1c09ea14-a446-4f07-8830-bc976b3c15a2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:39.658243 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1c09ea14-a446-4f07-8830-bc976b3c15a2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:39.660583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1c09ea14-a446-4f07-8830-bc976b3c15a2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:39.661544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1c09ea14-a446-4f07-8830-bc976b3c15a2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:39.713184 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:39.880087 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6c15ab83-5aed-4c8e-847f-dcc7f6c1af74 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:39.881410 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6c15ab83-5aed-4c8e-847f-dcc7f6c1af74 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:39.889011 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6c15ab83-5aed-4c8e-847f-dcc7f6c1af74 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:39.889725 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6c15ab83-5aed-4c8e-847f-dcc7f6c1af74 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:39.890717 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6c15ab83-5aed-4c8e-847f-dcc7f6c1af74 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:39.891358 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6c15ab83-5aed-4c8e-847f-dcc7f6c1af74 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:39.954578 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1c09ea14-a446-4f07-8830-bc976b3c15a2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:39.971157 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1c09ea14-a446-4f07-8830-bc976b3c15a2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.336169 Jun 23 16:01:39.973104 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 53/118] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:39 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:39.986412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-837a6e0f-fef1-4893-b4aa-52d645ef6b5c tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:39.987603 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-837a6e0f-fef1-4893-b4aa-52d645ef6b5c tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:40.001498 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-837a6e0f-fef1-4893-b4aa-52d645ef6b5c tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:40.002590 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-837a6e0f-fef1-4893-b4aa-52d645ef6b5c tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:40.004277 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-837a6e0f-fef1-4893-b4aa-52d645ef6b5c tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:40.005239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-837a6e0f-fef1-4893-b4aa-52d645ef6b5c tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:40.107845 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6c15ab83-5aed-4c8e-847f-dcc7f6c1af74 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:40.132935 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6c15ab83-5aed-4c8e-847f-dcc7f6c1af74 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.257446 Jun 23 16:01:40.150188 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 66/119] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:39 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:40.160664 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-17ed64f9-c4c1-47b1-b95b-3f830c45f775 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:40.162892 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-17ed64f9-c4c1-47b1-b95b-3f830c45f775 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:40.171380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17ed64f9-c4c1-47b1-b95b-3f830c45f775 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:40.171380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17ed64f9-c4c1-47b1-b95b-3f830c45f775 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:40.172163 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17ed64f9-c4c1-47b1-b95b-3f830c45f775 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:40.172881 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17ed64f9-c4c1-47b1-b95b-3f830c45f775 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:40.238543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-837a6e0f-fef1-4893-b4aa-52d645ef6b5c tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:40.247622 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-837a6e0f-fef1-4893-b4aa-52d645ef6b5c tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.272439 Jun 23 16:01:40.258035 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 54/120] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:39 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:40.386829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-17ed64f9-c4c1-47b1-b95b-3f830c45f775 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:40.404362 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-17ed64f9-c4c1-47b1-b95b-3f830c45f775 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:40.409184 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-17ed64f9-c4c1-47b1-b95b-3f830c45f775 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:40.415622 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-17ed64f9-c4c1-47b1-b95b-3f830c45f775 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.260716 Jun 23 16:01:40.422883 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 67/121] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:40 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:40.990323 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-642a7afa-cef9-426d-a740-1cdd94189cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:40.991212 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-642a7afa-cef9-426d-a740-1cdd94189cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:41.003348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-642a7afa-cef9-426d-a740-1cdd94189cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:41.003733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-642a7afa-cef9-426d-a740-1cdd94189cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:41.004580 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-642a7afa-cef9-426d-a740-1cdd94189cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:41.005012 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-642a7afa-cef9-426d-a740-1cdd94189cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:41.171944 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1eba256f-ec3e-407a-8f84-89a0da402e97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:41.176670 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1eba256f-ec3e-407a-8f84-89a0da402e97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:41.192656 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1eba256f-ec3e-407a-8f84-89a0da402e97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:41.195540 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1eba256f-ec3e-407a-8f84-89a0da402e97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:41.198309 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1eba256f-ec3e-407a-8f84-89a0da402e97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:41.200596 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1eba256f-ec3e-407a-8f84-89a0da402e97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:41.308962 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-642a7afa-cef9-426d-a740-1cdd94189cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:41.317893 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-642a7afa-cef9-426d-a740-1cdd94189cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.331682 Jun 23 16:01:41.320392 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 55/122] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:40 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:41.326489 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dff886c1-3a24-4936-8c81-e3916ce19a57 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:41.327373 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dff886c1-3a24-4936-8c81-e3916ce19a57 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:41.336138 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dff886c1-3a24-4936-8c81-e3916ce19a57 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:41.337430 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dff886c1-3a24-4936-8c81-e3916ce19a57 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:41.338394 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dff886c1-3a24-4936-8c81-e3916ce19a57 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:41.339027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dff886c1-3a24-4936-8c81-e3916ce19a57 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:41.506369 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1eba256f-ec3e-407a-8f84-89a0da402e97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:41.515487 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1eba256f-ec3e-407a-8f84-89a0da402e97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.355647 Jun 23 16:01:41.527936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 68/123] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:41 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:41.536824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-11a22e4a-94d3-4b78-9a65-51e2632b85dc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:41.536824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-11a22e4a-94d3-4b78-9a65-51e2632b85dc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:41.543244 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11a22e4a-94d3-4b78-9a65-51e2632b85dc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:41.543685 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11a22e4a-94d3-4b78-9a65-51e2632b85dc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:41.545120 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11a22e4a-94d3-4b78-9a65-51e2632b85dc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:41.545711 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-11a22e4a-94d3-4b78-9a65-51e2632b85dc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:41.689523 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dff886c1-3a24-4936-8c81-e3916ce19a57 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:41.704556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dff886c1-3a24-4936-8c81-e3916ce19a57 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.382146 Jun 23 16:01:41.706916 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 56/124] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:41 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:41.742057 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-11a22e4a-94d3-4b78-9a65-51e2632b85dc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:41.755962 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-11a22e4a-94d3-4b78-9a65-51e2632b85dc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:41.759723 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-11a22e4a-94d3-4b78-9a65-51e2632b85dc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:41.761236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-11a22e4a-94d3-4b78-9a65-51e2632b85dc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.243726 Jun 23 16:01:41.761965 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 69/125] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:41 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:42.151714 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-a811665c-4de2-45ce-a723-cf22dd7549b1 req-96a92b77-f2f2-4229-8172-5bb543f31551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff2e14e-d713-4245-be6a-3055e546bd1d", "name": "network-vif-plugged", "status": "completed", "tag": "4432f611-e405-4a38-b98a-2d230d1bbc40"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:42.163506 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-a811665c-4de2-45ce-a723-cf22dd7549b1 req-96a92b77-f2f2-4229-8172-5bb543f31551 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:42.164041 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-a811665c-4de2-45ce-a723-cf22dd7549b1 req-96a92b77-f2f2-4229-8172-5bb543f31551 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:42.178933 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-a811665c-4de2-45ce-a723-cf22dd7549b1 req-96a92b77-f2f2-4229-8172-5bb543f31551 service nova] Creating event network-vif-plugged:4432f611-e405-4a38-b98a-2d230d1bbc40 for instance 0ff2e14e-d713-4245-be6a-3055e546bd1d on hv-cinder-83538 Jun 23 16:01:42.189212 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-a811665c-4de2-45ce-a723-cf22dd7549b1 req-96a92b77-f2f2-4229-8172-5bb543f31551 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.310358 Jun 23 16:01:42.190026 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 57/126] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:01:42.339097 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ff3575c9-0ebc-4b1d-95fb-6a0040112c96 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:42.340699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ff3575c9-0ebc-4b1d-95fb-6a0040112c96 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:42.358869 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ff3575c9-0ebc-4b1d-95fb-6a0040112c96 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:42.359813 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ff3575c9-0ebc-4b1d-95fb-6a0040112c96 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:42.361077 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ff3575c9-0ebc-4b1d-95fb-6a0040112c96 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:42.361735 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ff3575c9-0ebc-4b1d-95fb-6a0040112c96 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:42.548687 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-24730ae5-aa9b-45a7-89f3-2a2f9d873b41 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:42.549693 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-24730ae5-aa9b-45a7-89f3-2a2f9d873b41 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:42.560919 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-24730ae5-aa9b-45a7-89f3-2a2f9d873b41 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:42.561777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-24730ae5-aa9b-45a7-89f3-2a2f9d873b41 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:42.562837 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-24730ae5-aa9b-45a7-89f3-2a2f9d873b41 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:42.563546 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-24730ae5-aa9b-45a7-89f3-2a2f9d873b41 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:42.629509 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ff3575c9-0ebc-4b1d-95fb-6a0040112c96 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:42.644747 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ff3575c9-0ebc-4b1d-95fb-6a0040112c96 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.310139 Jun 23 16:01:42.646200 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 70/127] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:42 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:42.726141 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d23dde8b-6570-43ef-bc10-2a538b39d1f8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:42.727169 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d23dde8b-6570-43ef-bc10-2a538b39d1f8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:42.773784 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d23dde8b-6570-43ef-bc10-2a538b39d1f8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:42.775074 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d23dde8b-6570-43ef-bc10-2a538b39d1f8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:42.776579 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d23dde8b-6570-43ef-bc10-2a538b39d1f8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:42.777247 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d23dde8b-6570-43ef-bc10-2a538b39d1f8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:42.869772 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-24730ae5-aa9b-45a7-89f3-2a2f9d873b41 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:42.883128 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-24730ae5-aa9b-45a7-89f3-2a2f9d873b41 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.341152 Jun 23 16:01:42.884466 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 58/128] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:42 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:42.890324 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f237ccf5-65a9-440e-8893-f506fd72ee49 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:42.891448 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f237ccf5-65a9-440e-8893-f506fd72ee49 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:42.899988 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f237ccf5-65a9-440e-8893-f506fd72ee49 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:42.901489 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f237ccf5-65a9-440e-8893-f506fd72ee49 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:42.902599 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f237ccf5-65a9-440e-8893-f506fd72ee49 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:42.903230 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f237ccf5-65a9-440e-8893-f506fd72ee49 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:43.145397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d23dde8b-6570-43ef-bc10-2a538b39d1f8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:43.156685 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d23dde8b-6570-43ef-bc10-2a538b39d1f8 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.436324 Jun 23 16:01:43.166971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 71/129] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:42 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:43.287639 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f237ccf5-65a9-440e-8893-f506fd72ee49 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:43.315638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f237ccf5-65a9-440e-8893-f506fd72ee49 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:43.320052 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f237ccf5-65a9-440e-8893-f506fd72ee49 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:43.323229 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f237ccf5-65a9-440e-8893-f506fd72ee49 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.436442 Jun 23 16:01:43.323830 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 59/130] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:42 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:43.672491 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4edb36be-4f0c-46ec-b448-8399a52493d1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:43.675209 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4edb36be-4f0c-46ec-b448-8399a52493d1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:43.701541 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4edb36be-4f0c-46ec-b448-8399a52493d1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:43.704507 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4edb36be-4f0c-46ec-b448-8399a52493d1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:43.706758 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4edb36be-4f0c-46ec-b448-8399a52493d1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:43.707944 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4edb36be-4f0c-46ec-b448-8399a52493d1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:43.915851 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4edb36be-4f0c-46ec-b448-8399a52493d1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:43.919502 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f022e8a0-62a8-4fdc-a261-4c557b538d72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:43.921861 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f022e8a0-62a8-4fdc-a261-4c557b538d72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:43.923974 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4edb36be-4f0c-46ec-b448-8399a52493d1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.264522 Jun 23 16:01:43.935126 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 72/131] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:43 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:43.939955 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f022e8a0-62a8-4fdc-a261-4c557b538d72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:43.940434 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f022e8a0-62a8-4fdc-a261-4c557b538d72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:43.941266 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f022e8a0-62a8-4fdc-a261-4c557b538d72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:43.941706 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f022e8a0-62a8-4fdc-a261-4c557b538d72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:44.147810 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f022e8a0-62a8-4fdc-a261-4c557b538d72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:44.158408 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f022e8a0-62a8-4fdc-a261-4c557b538d72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.249024 Jun 23 16:01:44.160296 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 60/132] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:43 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:44.176419 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c89a3331-4caa-4c24-afd9-2e03aa000e71 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:44.177285 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c89a3331-4caa-4c24-afd9-2e03aa000e71 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:44.197419 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c89a3331-4caa-4c24-afd9-2e03aa000e71 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:44.198361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c89a3331-4caa-4c24-afd9-2e03aa000e71 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:44.200574 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c89a3331-4caa-4c24-afd9-2e03aa000e71 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:44.203011 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c89a3331-4caa-4c24-afd9-2e03aa000e71 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:44.360899 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7958f2d9-9917-4045-82ce-ffa48454b2be tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:44.362571 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7958f2d9-9917-4045-82ce-ffa48454b2be tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:44.387090 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7958f2d9-9917-4045-82ce-ffa48454b2be tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:44.389933 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7958f2d9-9917-4045-82ce-ffa48454b2be tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:44.396989 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7958f2d9-9917-4045-82ce-ffa48454b2be tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:44.398222 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7958f2d9-9917-4045-82ce-ffa48454b2be tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:44.618937 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c89a3331-4caa-4c24-afd9-2e03aa000e71 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:44.635761 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c89a3331-4caa-4c24-afd9-2e03aa000e71 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.463211 Jun 23 16:01:44.637969 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 73/133] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:44 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:44.788800 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7958f2d9-9917-4045-82ce-ffa48454b2be tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:44.815362 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7958f2d9-9917-4045-82ce-ffa48454b2be tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:44.822237 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7958f2d9-9917-4045-82ce-ffa48454b2be tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:44.826584 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7958f2d9-9917-4045-82ce-ffa48454b2be tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.480028 Jun 23 16:01:44.829009 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 61/134] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:44 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:44.946661 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dea9ed11-9ee5-44c7-a055-b2222ca58a6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:44.948739 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-dea9ed11-9ee5-44c7-a055-b2222ca58a6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:44.956991 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:44.960021 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dea9ed11-9ee5-44c7-a055-b2222ca58a6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:44.960916 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dea9ed11-9ee5-44c7-a055-b2222ca58a6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:44.963726 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dea9ed11-9ee5-44c7-a055-b2222ca58a6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:44.964393 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dea9ed11-9ee5-44c7-a055-b2222ca58a6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:45.190193 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a453053d-2fab-4f59-ab82-3d8643fe821c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:45.196561 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a453053d-2fab-4f59-ab82-3d8643fe821c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:45.221015 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a453053d-2fab-4f59-ab82-3d8643fe821c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:45.221782 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a453053d-2fab-4f59-ab82-3d8643fe821c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:45.227647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a453053d-2fab-4f59-ab82-3d8643fe821c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:45.228628 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a453053d-2fab-4f59-ab82-3d8643fe821c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:45.467993 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-dea9ed11-9ee5-44c7-a055-b2222ca58a6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:45.498586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-dea9ed11-9ee5-44c7-a055-b2222ca58a6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.559023 Jun 23 16:01:45.499635 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 74/135] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:44 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:45.659726 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-817e0eb8-4da2-479e-9c9f-e4ce02c9f02f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:45.661062 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-817e0eb8-4da2-479e-9c9f-e4ce02c9f02f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:45.704996 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-817e0eb8-4da2-479e-9c9f-e4ce02c9f02f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:45.705795 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-817e0eb8-4da2-479e-9c9f-e4ce02c9f02f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:45.707785 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-817e0eb8-4da2-479e-9c9f-e4ce02c9f02f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:45.708989 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-817e0eb8-4da2-479e-9c9f-e4ce02c9f02f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:46.747190 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a453053d-2fab-4f59-ab82-3d8643fe821c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:46.774552 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a453053d-2fab-4f59-ab82-3d8643fe821c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 1.590802 Jun 23 16:01:46.775833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 62/136] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:45 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:46.829320 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-35b53238-2df0-4bbc-ae96-889b58cb8f21 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:46.830615 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-35b53238-2df0-4bbc-ae96-889b58cb8f21 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:46.858107 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35b53238-2df0-4bbc-ae96-889b58cb8f21 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:46.858940 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35b53238-2df0-4bbc-ae96-889b58cb8f21 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:46.871624 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35b53238-2df0-4bbc-ae96-889b58cb8f21 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:46.871944 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-35b53238-2df0-4bbc-ae96-889b58cb8f21 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:47.168227 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-817e0eb8-4da2-479e-9c9f-e4ce02c9f02f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:47.213171 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-817e0eb8-4da2-479e-9c9f-e4ce02c9f02f tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 1.546899 Jun 23 16:01:47.214254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 75/137] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:45 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:47.238551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-64bc0b71-4597-4fba-97d6-32682413e44d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:47.241102 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-64bc0b71-4597-4fba-97d6-32682413e44d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:47.272902 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-64bc0b71-4597-4fba-97d6-32682413e44d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:47.273985 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-64bc0b71-4597-4fba-97d6-32682413e44d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:47.276182 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-64bc0b71-4597-4fba-97d6-32682413e44d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:47.277256 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-64bc0b71-4597-4fba-97d6-32682413e44d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:47.757618 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-35b53238-2df0-4bbc-ae96-889b58cb8f21 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:47.792895 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-35b53238-2df0-4bbc-ae96-889b58cb8f21 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:47.801649 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-35b53238-2df0-4bbc-ae96-889b58cb8f21 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:47.813884 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-35b53238-2df0-4bbc-ae96-889b58cb8f21 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 1.036216 Jun 23 16:01:47.816083 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 63/138] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:46 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:47.839870 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-6ddbc3a3-9547-4804-9cc6-7d990e6fe714 req-19f1fbcc-4ab5-4d86-a4c7-6ea1bb63ab77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030dcf0e-dfb9-4e58-a617-f6330ae03134", "name": "network-vif-plugged", "status": "completed", "tag": "492927a9-54a0-4835-8cdd-c1cd95b4eac3"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:47.878029 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-6ddbc3a3-9547-4804-9cc6-7d990e6fe714 req-19f1fbcc-4ab5-4d86-a4c7-6ea1bb63ab77 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:47.879471 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-6ddbc3a3-9547-4804-9cc6-7d990e6fe714 req-19f1fbcc-4ab5-4d86-a4c7-6ea1bb63ab77 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:47.924166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-6ddbc3a3-9547-4804-9cc6-7d990e6fe714 req-19f1fbcc-4ab5-4d86-a4c7-6ea1bb63ab77 service nova] Creating event network-vif-plugged:492927a9-54a0-4835-8cdd-c1cd95b4eac3 for instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 on hv-cinder-83538 Jun 23 16:01:47.948600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-6ddbc3a3-9547-4804-9cc6-7d990e6fe714 req-19f1fbcc-4ab5-4d86-a4c7-6ea1bb63ab77 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130409 Jun 23 16:01:47.950141 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 64/139] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:47.980763 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ca6b14ce-3c96-4c68-9e12-6827effc75eb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:47.981663 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ca6b14ce-3c96-4c68-9e12-6827effc75eb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:47.996325 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ca6b14ce-3c96-4c68-9e12-6827effc75eb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:47.997063 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ca6b14ce-3c96-4c68-9e12-6827effc75eb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:47.997872 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ca6b14ce-3c96-4c68-9e12-6827effc75eb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:47.998472 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ca6b14ce-3c96-4c68-9e12-6827effc75eb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:48.398919 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-64bc0b71-4597-4fba-97d6-32682413e44d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:48.429261 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-64bc0b71-4597-4fba-97d6-32682413e44d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 1.208531 Jun 23 16:01:48.444046 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 76/140] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:47 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:48.460359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a2622c77-fc29-4314-b0b6-0326ce633bbe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:48.461899 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a2622c77-fc29-4314-b0b6-0326ce633bbe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:48.477021 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2622c77-fc29-4314-b0b6-0326ce633bbe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:48.478580 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2622c77-fc29-4314-b0b6-0326ce633bbe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:48.480737 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2622c77-fc29-4314-b0b6-0326ce633bbe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:48.481928 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2622c77-fc29-4314-b0b6-0326ce633bbe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:48.657516 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ca6b14ce-3c96-4c68-9e12-6827effc75eb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:48.684827 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ca6b14ce-3c96-4c68-9e12-6827effc75eb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.730394 Jun 23 16:01:48.689117 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 65/141] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:47 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:48.848868 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9dab34fd-de00-4d1e-ad64-f8598c8cfa14 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:48.851892 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9dab34fd-de00-4d1e-ad64-f8598c8cfa14 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:48.875010 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:48.881125 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9dab34fd-de00-4d1e-ad64-f8598c8cfa14 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:48.884282 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9dab34fd-de00-4d1e-ad64-f8598c8cfa14 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:48.890089 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9dab34fd-de00-4d1e-ad64-f8598c8cfa14 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:48.892068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9dab34fd-de00-4d1e-ad64-f8598c8cfa14 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:48.895311 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a2622c77-fc29-4314-b0b6-0326ce633bbe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:48.951558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a2622c77-fc29-4314-b0b6-0326ce633bbe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.499580 Jun 23 16:01:48.961953 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 77/142] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:48 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:49.284172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9dab34fd-de00-4d1e-ad64-f8598c8cfa14 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:49.308437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9dab34fd-de00-4d1e-ad64-f8598c8cfa14 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:49.312572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9dab34fd-de00-4d1e-ad64-f8598c8cfa14 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:49.314984 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9dab34fd-de00-4d1e-ad64-f8598c8cfa14 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.482090 Jun 23 16:01:49.327291 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 66/143] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:48 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:01:49.475737 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f7542b62-f401-4d3b-855f-7354ba8ab160 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:49.476840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f7542b62-f401-4d3b-855f-7354ba8ab160 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:49.490887 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7542b62-f401-4d3b-855f-7354ba8ab160 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:49.491696 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7542b62-f401-4d3b-855f-7354ba8ab160 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:49.493678 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7542b62-f401-4d3b-855f-7354ba8ab160 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:49.494471 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f7542b62-f401-4d3b-855f-7354ba8ab160 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:49.501494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:49.716631 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-46c37f66-8ac5-4241-88c0-0e6e534715fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:49.717920 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-46c37f66-8ac5-4241-88c0-0e6e534715fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:49.736451 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46c37f66-8ac5-4241-88c0-0e6e534715fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:49.744810 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46c37f66-8ac5-4241-88c0-0e6e534715fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:49.751028 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f7542b62-f401-4d3b-855f-7354ba8ab160 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:49.751271 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46c37f66-8ac5-4241-88c0-0e6e534715fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:49.752095 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46c37f66-8ac5-4241-88c0-0e6e534715fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:49.765885 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f7542b62-f401-4d3b-855f-7354ba8ab160 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.310088 Jun 23 16:01:49.767439 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 78/144] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:49 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:49.942894 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-46c37f66-8ac5-4241-88c0-0e6e534715fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:49.954136 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-46c37f66-8ac5-4241-88c0-0e6e534715fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.244332 Jun 23 16:01:49.954931 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 67/145] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:49 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:49.980965 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-82ad1801-f642-4899-9992-822cbdbb92ec req-62ec7504-9f86-4c61-9606-ce951b7a7ca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777072f3-db6b-4c68-8fbb-e300170a00b8", "name": "network-vif-plugged", "status": "completed", "tag": "5a29fed5-a9ab-4a4e-801f-a191224a8a53"}, {"server_uuid": "14021a2e-8af8-4292-996e-ea87ff7752e0", "name": "network-vif-plugged", "status": "completed", "tag": "15db635b-5851-4528-8f58-f9ba091f51a6"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:49.992063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-82ad1801-f642-4899-9992-822cbdbb92ec req-62ec7504-9f86-4c61-9606-ce951b7a7ca2 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:49.992642 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-82ad1801-f642-4899-9992-822cbdbb92ec req-62ec7504-9f86-4c61-9606-ce951b7a7ca2 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:50.010166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-015e3d20-b7d1-4580-88d5-88a240803fd4 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:50.010976 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-015e3d20-b7d1-4580-88d5-88a240803fd4 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:50.011265 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-82ad1801-f642-4899-9992-822cbdbb92ec req-62ec7504-9f86-4c61-9606-ce951b7a7ca2 service nova] Creating event network-vif-plugged:5a29fed5-a9ab-4a4e-801f-a191224a8a53 for instance 777072f3-db6b-4c68-8fbb-e300170a00b8 on hv-cinder-83538 Jun 23 16:01:50.012007 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-82ad1801-f642-4899-9992-822cbdbb92ec req-62ec7504-9f86-4c61-9606-ce951b7a7ca2 service nova] Creating event network-vif-plugged:15db635b-5851-4528-8f58-f9ba091f51a6 for instance 14021a2e-8af8-4292-996e-ea87ff7752e0 on hv-cinder-83538 Jun 23 16:01:50.027607 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-82ad1801-f642-4899-9992-822cbdbb92ec req-62ec7504-9f86-4c61-9606-ce951b7a7ca2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.053473 Jun 23 16:01:50.027826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-015e3d20-b7d1-4580-88d5-88a240803fd4 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:50.028411 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 79/146] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:50.028703 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-015e3d20-b7d1-4580-88d5-88a240803fd4 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:50.030340 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-015e3d20-b7d1-4580-88d5-88a240803fd4 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:50.031384 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-015e3d20-b7d1-4580-88d5-88a240803fd4 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:50.204517 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-015e3d20-b7d1-4580-88d5-88a240803fd4 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:50.219356 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-015e3d20-b7d1-4580-88d5-88a240803fd4 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1312 microversion: 2.1 time: 0.226690 Jun 23 16:01:50.220973 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 68/147] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:49 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1312 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:50.339899 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e892a93a-8d2b-45e8-915c-828101eee18c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:50.340607 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e892a93a-8d2b-45e8-915c-828101eee18c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:50.348285 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e892a93a-8d2b-45e8-915c-828101eee18c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:50.348997 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e892a93a-8d2b-45e8-915c-828101eee18c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:50.349908 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e892a93a-8d2b-45e8-915c-828101eee18c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:50.350352 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e892a93a-8d2b-45e8-915c-828101eee18c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:50.560809 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e892a93a-8d2b-45e8-915c-828101eee18c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:50.572047 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e892a93a-8d2b-45e8-915c-828101eee18c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:50.573685 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e892a93a-8d2b-45e8-915c-828101eee18c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:50.574975 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e892a93a-8d2b-45e8-915c-828101eee18c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.240451 Jun 23 16:01:50.575544 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 80/148] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:50 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:50.801118 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7592d8cf-ad09-4a01-a704-a8be34e6c0b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:50.803069 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7592d8cf-ad09-4a01-a704-a8be34e6c0b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:50.818092 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7592d8cf-ad09-4a01-a704-a8be34e6c0b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:50.818611 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7592d8cf-ad09-4a01-a704-a8be34e6c0b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:50.820930 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7592d8cf-ad09-4a01-a704-a8be34e6c0b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:50.821736 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7592d8cf-ad09-4a01-a704-a8be34e6c0b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:50.993604 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3add4277-4d2a-42fa-bc0c-3e3ee9b2e25e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:50.994750 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3add4277-4d2a-42fa-bc0c-3e3ee9b2e25e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:51.005828 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3add4277-4d2a-42fa-bc0c-3e3ee9b2e25e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:51.006642 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3add4277-4d2a-42fa-bc0c-3e3ee9b2e25e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:51.008114 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3add4277-4d2a-42fa-bc0c-3e3ee9b2e25e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:51.009443 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3add4277-4d2a-42fa-bc0c-3e3ee9b2e25e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:51.059444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7592d8cf-ad09-4a01-a704-a8be34e6c0b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:51.070069 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7592d8cf-ad09-4a01-a704-a8be34e6c0b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.287830 Jun 23 16:01:51.071537 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 69/149] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:50 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:51.223815 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3add4277-4d2a-42fa-bc0c-3e3ee9b2e25e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:51.244729 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-236ebf48-81ca-4759-bcd9-79ea9b6cade5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:51.245693 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-236ebf48-81ca-4759-bcd9-79ea9b6cade5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:51.259637 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3add4277-4d2a-42fa-bc0c-3e3ee9b2e25e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.284647 Jun 23 16:01:51.280666 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 81/150] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:50 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:51.281305 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-236ebf48-81ca-4759-bcd9-79ea9b6cade5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:51.282058 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-236ebf48-81ca-4759-bcd9-79ea9b6cade5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:51.285399 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-236ebf48-81ca-4759-bcd9-79ea9b6cade5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:51.286147 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-236ebf48-81ca-4759-bcd9-79ea9b6cade5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:51.562142 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-236ebf48-81ca-4759-bcd9-79ea9b6cade5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:51.577311 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-236ebf48-81ca-4759-bcd9-79ea9b6cade5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1499 microversion: 2.1 time: 0.341775 Jun 23 16:01:51.579003 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 70/151] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:51 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1499 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:51.596395 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-eabbb532-41cd-408a-881e-fca058ea2cf7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:51.597946 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-eabbb532-41cd-408a-881e-fca058ea2cf7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:51.607010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eabbb532-41cd-408a-881e-fca058ea2cf7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:51.607783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eabbb532-41cd-408a-881e-fca058ea2cf7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:51.608837 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eabbb532-41cd-408a-881e-fca058ea2cf7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:51.609561 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eabbb532-41cd-408a-881e-fca058ea2cf7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:51.778838 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-eabbb532-41cd-408a-881e-fca058ea2cf7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:51.788381 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-eabbb532-41cd-408a-881e-fca058ea2cf7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:51.793914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-eabbb532-41cd-408a-881e-fca058ea2cf7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:51.795120 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-eabbb532-41cd-408a-881e-fca058ea2cf7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.203314 Jun 23 16:01:51.795699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 82/152] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:51 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:52.097532 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-528256ac-97cd-4b05-b3bb-b22dfa3b91e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:52.099137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-528256ac-97cd-4b05-b3bb-b22dfa3b91e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:52.121144 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-528256ac-97cd-4b05-b3bb-b22dfa3b91e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:52.125745 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-528256ac-97cd-4b05-b3bb-b22dfa3b91e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:52.127814 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-528256ac-97cd-4b05-b3bb-b22dfa3b91e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:52.131464 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-528256ac-97cd-4b05-b3bb-b22dfa3b91e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:52.165148 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:01:52.293268 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b68fab48-df54-497c-a2d4-33453d4cb5e2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:52.294468 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b68fab48-df54-497c-a2d4-33453d4cb5e2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:52.310471 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b68fab48-df54-497c-a2d4-33453d4cb5e2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:52.311210 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b68fab48-df54-497c-a2d4-33453d4cb5e2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:52.312262 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b68fab48-df54-497c-a2d4-33453d4cb5e2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:52.313071 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b68fab48-df54-497c-a2d4-33453d4cb5e2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:52.363660 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-528256ac-97cd-4b05-b3bb-b22dfa3b91e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:52.387892 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-528256ac-97cd-4b05-b3bb-b22dfa3b91e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.298723 Jun 23 16:01:52.388486 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 71/153] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:52 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:52.538873 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b68fab48-df54-497c-a2d4-33453d4cb5e2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:52.557204 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b68fab48-df54-497c-a2d4-33453d4cb5e2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.267280 Jun 23 16:01:52.559126 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 83/154] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:52 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:52.818965 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2c5c1f1c-0824-40af-9060-143bbd915d9b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:52.820263 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2c5c1f1c-0824-40af-9060-143bbd915d9b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:52.832168 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c5c1f1c-0824-40af-9060-143bbd915d9b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:52.833097 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c5c1f1c-0824-40af-9060-143bbd915d9b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:52.834735 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c5c1f1c-0824-40af-9060-143bbd915d9b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:52.835801 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c5c1f1c-0824-40af-9060-143bbd915d9b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:53.068330 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2c5c1f1c-0824-40af-9060-143bbd915d9b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:53.085238 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2c5c1f1c-0824-40af-9060-143bbd915d9b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:53.089815 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2c5c1f1c-0824-40af-9060-143bbd915d9b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:53.092175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2c5c1f1c-0824-40af-9060-143bbd915d9b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.280791 Jun 23 16:01:53.094720 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 72/155] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:52 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:53.405990 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a6530060-04d2-4eab-9457-bf3037f12578 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:53.406647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a6530060-04d2-4eab-9457-bf3037f12578 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:53.413434 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6530060-04d2-4eab-9457-bf3037f12578 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:53.414622 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6530060-04d2-4eab-9457-bf3037f12578 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:53.416003 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6530060-04d2-4eab-9457-bf3037f12578 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:53.416624 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6530060-04d2-4eab-9457-bf3037f12578 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:53.582526 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f984a0d5-b224-4e88-a6bd-7bddf71cd61a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:53.584066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f984a0d5-b224-4e88-a6bd-7bddf71cd61a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:53.606490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f984a0d5-b224-4e88-a6bd-7bddf71cd61a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:53.608363 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f984a0d5-b224-4e88-a6bd-7bddf71cd61a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:53.609462 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f984a0d5-b224-4e88-a6bd-7bddf71cd61a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:53.611236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f984a0d5-b224-4e88-a6bd-7bddf71cd61a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:53.615662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a6530060-04d2-4eab-9457-bf3037f12578 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:53.629119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a6530060-04d2-4eab-9457-bf3037f12578 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.226885 Jun 23 16:01:53.640179 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 84/156] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:53 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:53.809318 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f984a0d5-b224-4e88-a6bd-7bddf71cd61a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:53.818939 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f984a0d5-b224-4e88-a6bd-7bddf71cd61a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.245092 Jun 23 16:01:53.829415 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 73/157] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:53 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:54.127965 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ebcb049c-7b2b-47b4-b9e7-cded2dd75ebb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:54.129857 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ebcb049c-7b2b-47b4-b9e7-cded2dd75ebb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:54.142502 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ebcb049c-7b2b-47b4-b9e7-cded2dd75ebb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:54.143342 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ebcb049c-7b2b-47b4-b9e7-cded2dd75ebb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:54.144010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ebcb049c-7b2b-47b4-b9e7-cded2dd75ebb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:54.144485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ebcb049c-7b2b-47b4-b9e7-cded2dd75ebb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:54.332535 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ebcb049c-7b2b-47b4-b9e7-cded2dd75ebb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:54.349419 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ebcb049c-7b2b-47b4-b9e7-cded2dd75ebb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:54.354074 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ebcb049c-7b2b-47b4-b9e7-cded2dd75ebb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:54.356532 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ebcb049c-7b2b-47b4-b9e7-cded2dd75ebb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.238377 Jun 23 16:01:54.361377 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 85/158] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:54 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:54.655136 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-09427197-6788-4c49-82e8-6647e7b0c701 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:54.655820 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-09427197-6788-4c49-82e8-6647e7b0c701 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:54.679842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09427197-6788-4c49-82e8-6647e7b0c701 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:54.680338 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09427197-6788-4c49-82e8-6647e7b0c701 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:54.687862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09427197-6788-4c49-82e8-6647e7b0c701 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:54.688563 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-09427197-6788-4c49-82e8-6647e7b0c701 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:54.843006 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cb04b80c-a79d-4bce-90f7-c5e8fe6d7d33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:54.845605 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cb04b80c-a79d-4bce-90f7-c5e8fe6d7d33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:54.875942 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cb04b80c-a79d-4bce-90f7-c5e8fe6d7d33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:54.877455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cb04b80c-a79d-4bce-90f7-c5e8fe6d7d33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:54.879967 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cb04b80c-a79d-4bce-90f7-c5e8fe6d7d33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:54.883652 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cb04b80c-a79d-4bce-90f7-c5e8fe6d7d33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:55.027000 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-09427197-6788-4c49-82e8-6647e7b0c701 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:55.039890 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-09427197-6788-4c49-82e8-6647e7b0c701 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.394933 Jun 23 16:01:55.041507 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 74/159] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:54 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:55.202439 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cb04b80c-a79d-4bce-90f7-c5e8fe6d7d33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:55.221026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cb04b80c-a79d-4bce-90f7-c5e8fe6d7d33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.387483 Jun 23 16:01:55.222604 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 86/160] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:54 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:55.379922 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-96db8972-7a8b-4d15-a8b5-f4dd9807b14a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:55.380704 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-96db8972-7a8b-4d15-a8b5-f4dd9807b14a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:55.389657 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96db8972-7a8b-4d15-a8b5-f4dd9807b14a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:55.390253 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96db8972-7a8b-4d15-a8b5-f4dd9807b14a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:55.391211 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96db8972-7a8b-4d15-a8b5-f4dd9807b14a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:55.391849 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96db8972-7a8b-4d15-a8b5-f4dd9807b14a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:55.484667 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9d5a842e-8fda-44b5-9ea7-ecea5068bab1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d51e4670-ef3b-4a64-9137-2b414b84ee1c"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:01:55.485821 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9d5a842e-8fda-44b5-9ea7-ecea5068bab1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:55.493376 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9d5a842e-8fda-44b5-9ea7-ecea5068bab1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:55.494200 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9d5a842e-8fda-44b5-9ea7-ecea5068bab1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:55.495386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9d5a842e-8fda-44b5-9ea7-ecea5068bab1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:55.495978 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9d5a842e-8fda-44b5-9ea7-ecea5068bab1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:55.811889 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-96db8972-7a8b-4d15-a8b5-f4dd9807b14a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:55.823766 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-96db8972-7a8b-4d15-a8b5-f4dd9807b14a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:55.825581 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-96db8972-7a8b-4d15-a8b5-f4dd9807b14a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:55.826734 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-96db8972-7a8b-4d15-a8b5-f4dd9807b14a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.452914 Jun 23 16:01:55.828520 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 75/161] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:55 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:56.065301 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-164cfbcb-23f2-445a-90da-d73338aeee7a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:56.065925 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-164cfbcb-23f2-445a-90da-d73338aeee7a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:56.074241 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-164cfbcb-23f2-445a-90da-d73338aeee7a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:56.074917 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-164cfbcb-23f2-445a-90da-d73338aeee7a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:56.075819 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-164cfbcb-23f2-445a-90da-d73338aeee7a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:56.076145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-164cfbcb-23f2-445a-90da-d73338aeee7a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:56.332606 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-164cfbcb-23f2-445a-90da-d73338aeee7a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:56.348131 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-164cfbcb-23f2-445a-90da-d73338aeee7a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.287054 Jun 23 16:01:56.349131 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 76/162] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:56 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:01:56.357468 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4ac6bff1-e123-42ee-a641-5d460efa9ba4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:56.358093 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4ac6bff1-e123-42ee-a641-5d460efa9ba4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:56.365360 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4ac6bff1-e123-42ee-a641-5d460efa9ba4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:56.365548 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4ac6bff1-e123-42ee-a641-5d460efa9ba4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:56.366225 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4ac6bff1-e123-42ee-a641-5d460efa9ba4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:56.366763 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4ac6bff1-e123-42ee-a641-5d460efa9ba4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:56.545555 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4ac6bff1-e123-42ee-a641-5d460efa9ba4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:56.569164 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4ac6bff1-e123-42ee-a641-5d460efa9ba4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.218903 Jun 23 16:01:56.569967 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 77/163] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:56 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:56.850303 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-23d8105c-16bf-42fd-b683-f4bf0fb073fb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:56.851731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-23d8105c-16bf-42fd-b683-f4bf0fb073fb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:56.861954 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23d8105c-16bf-42fd-b683-f4bf0fb073fb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:56.862439 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23d8105c-16bf-42fd-b683-f4bf0fb073fb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:56.863868 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23d8105c-16bf-42fd-b683-f4bf0fb073fb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:56.864559 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23d8105c-16bf-42fd-b683-f4bf0fb073fb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:57.041344 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-23d8105c-16bf-42fd-b683-f4bf0fb073fb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:57.058837 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-23d8105c-16bf-42fd-b683-f4bf0fb073fb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:57.060392 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-23d8105c-16bf-42fd-b683-f4bf0fb073fb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:57.062069 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-23d8105c-16bf-42fd-b683-f4bf0fb073fb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.217562 Jun 23 16:01:57.062968 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 78/164] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:56 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:01:57.381163 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0b0d851a-9759-4dfa-8bf9-5baac6a5536e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:57.382011 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0b0d851a-9759-4dfa-8bf9-5baac6a5536e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:57.403071 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0b0d851a-9759-4dfa-8bf9-5baac6a5536e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:57.404500 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0b0d851a-9759-4dfa-8bf9-5baac6a5536e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:57.405674 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0b0d851a-9759-4dfa-8bf9-5baac6a5536e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:57.407282 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0b0d851a-9759-4dfa-8bf9-5baac6a5536e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:57.682102 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0b0d851a-9759-4dfa-8bf9-5baac6a5536e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:57.692199 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0b0d851a-9759-4dfa-8bf9-5baac6a5536e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.317909 Jun 23 16:01:57.702740 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 79/165] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:57 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:57.709725 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0624c08f-cf27-478d-9e35-01539812993d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:57.710559 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0624c08f-cf27-478d-9e35-01539812993d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:57.718044 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0624c08f-cf27-478d-9e35-01539812993d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:57.719108 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0624c08f-cf27-478d-9e35-01539812993d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:57.720487 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0624c08f-cf27-478d-9e35-01539812993d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:57.721432 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0624c08f-cf27-478d-9e35-01539812993d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:57.901401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0624c08f-cf27-478d-9e35-01539812993d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:57.908966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0624c08f-cf27-478d-9e35-01539812993d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.204695 Jun 23 16:01:57.909561 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 80/166] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:57 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:58.081955 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-01af60f2-7a13-440a-8bc0-9ee8157dc9e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:58.083002 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-01af60f2-7a13-440a-8bc0-9ee8157dc9e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:58.090942 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01af60f2-7a13-440a-8bc0-9ee8157dc9e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:58.091782 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01af60f2-7a13-440a-8bc0-9ee8157dc9e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:58.092722 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01af60f2-7a13-440a-8bc0-9ee8157dc9e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:58.093243 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01af60f2-7a13-440a-8bc0-9ee8157dc9e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:58.302483 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-01af60f2-7a13-440a-8bc0-9ee8157dc9e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:58.317777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-01af60f2-7a13-440a-8bc0-9ee8157dc9e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:58.321666 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-01af60f2-7a13-440a-8bc0-9ee8157dc9e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:58.324046 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-01af60f2-7a13-440a-8bc0-9ee8157dc9e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.245843 Jun 23 16:01:58.325833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 81/167] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:58 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:01:58.659210 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9d5a842e-8fda-44b5-9ea7-ecea5068bab1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "POST /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.178603 Jun 23 16:01:58.660529 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 87/168] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:01:55 2022] POST /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d/os-volume_attachments => generated 194 bytes in 3181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:01:58.711697 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8b6b11aa-9f23-47db-b8c6-07b191a5d13f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:58.712472 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8b6b11aa-9f23-47db-b8c6-07b191a5d13f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:58.720474 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8b6b11aa-9f23-47db-b8c6-07b191a5d13f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:58.721040 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8b6b11aa-9f23-47db-b8c6-07b191a5d13f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:58.722035 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8b6b11aa-9f23-47db-b8c6-07b191a5d13f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:58.723011 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8b6b11aa-9f23-47db-b8c6-07b191a5d13f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:58.891544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8b6b11aa-9f23-47db-b8c6-07b191a5d13f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:58.900674 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8b6b11aa-9f23-47db-b8c6-07b191a5d13f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.194247 Jun 23 16:01:58.901959 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 82/169] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:58 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:58.928843 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1ac45ea1-f5c0-4fbf-b6ad-f33c0b99dc57 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:58.929562 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1ac45ea1-f5c0-4fbf-b6ad-f33c0b99dc57 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:58.936742 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1ac45ea1-f5c0-4fbf-b6ad-f33c0b99dc57 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:58.937189 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1ac45ea1-f5c0-4fbf-b6ad-f33c0b99dc57 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:58.937973 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1ac45ea1-f5c0-4fbf-b6ad-f33c0b99dc57 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:58.938584 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1ac45ea1-f5c0-4fbf-b6ad-f33c0b99dc57 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:59.173788 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1ac45ea1-f5c0-4fbf-b6ad-f33c0b99dc57 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:59.183144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1ac45ea1-f5c0-4fbf-b6ad-f33c0b99dc57 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.259938 Jun 23 16:01:59.183796 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 88/170] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:58 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:01:59.348246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e8989f6c-7ff9-47fd-aa33-1599afcb1277 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:59.349157 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e8989f6c-7ff9-47fd-aa33-1599afcb1277 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:59.373013 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e8989f6c-7ff9-47fd-aa33-1599afcb1277 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:59.373929 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e8989f6c-7ff9-47fd-aa33-1599afcb1277 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:59.375775 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e8989f6c-7ff9-47fd-aa33-1599afcb1277 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:59.376721 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e8989f6c-7ff9-47fd-aa33-1599afcb1277 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:59.607267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e8989f6c-7ff9-47fd-aa33-1599afcb1277 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:59.623677 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e8989f6c-7ff9-47fd-aa33-1599afcb1277 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:59.625730 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e8989f6c-7ff9-47fd-aa33-1599afcb1277 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:01:59.627481 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e8989f6c-7ff9-47fd-aa33-1599afcb1277 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.283431 Jun 23 16:01:59.640380 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 83/171] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:01:59 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:01:59.921720 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c5eb40e3-1182-45f4-a58b-f9b64fd3a6ee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:01:59.922549 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c5eb40e3-1182-45f4-a58b-f9b64fd3a6ee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:01:59.929486 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5eb40e3-1182-45f4-a58b-f9b64fd3a6ee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:59.930661 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5eb40e3-1182-45f4-a58b-f9b64fd3a6ee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:01:59.931703 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5eb40e3-1182-45f4-a58b-f9b64fd3a6ee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:01:59.932498 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5eb40e3-1182-45f4-a58b-f9b64fd3a6ee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:00.142009 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c5eb40e3-1182-45f4-a58b-f9b64fd3a6ee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:00.152171 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c5eb40e3-1182-45f4-a58b-f9b64fd3a6ee tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.237077 Jun 23 16:02:00.152558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 89/172] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:01:59 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:00.202318 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-963c98f7-6cc8-4fa2-b6c9-ec05a7b19014 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:00.203008 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-963c98f7-6cc8-4fa2-b6c9-ec05a7b19014 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:00.210637 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-963c98f7-6cc8-4fa2-b6c9-ec05a7b19014 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:00.211155 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-963c98f7-6cc8-4fa2-b6c9-ec05a7b19014 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:00.212126 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-963c98f7-6cc8-4fa2-b6c9-ec05a7b19014 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:00.212560 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-963c98f7-6cc8-4fa2-b6c9-ec05a7b19014 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:00.395506 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-963c98f7-6cc8-4fa2-b6c9-ec05a7b19014 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:00.405562 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-963c98f7-6cc8-4fa2-b6c9-ec05a7b19014 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.208683 Jun 23 16:02:00.406386 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 84/173] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:00 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:00.646738 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4cd88fce-b9c1-4947-9e95-7c5e29756adc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:00.647665 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4cd88fce-b9c1-4947-9e95-7c5e29756adc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:00.656968 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4cd88fce-b9c1-4947-9e95-7c5e29756adc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:00.657890 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4cd88fce-b9c1-4947-9e95-7c5e29756adc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:00.659156 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4cd88fce-b9c1-4947-9e95-7c5e29756adc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:00.659658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4cd88fce-b9c1-4947-9e95-7c5e29756adc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:00.841273 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4cd88fce-b9c1-4947-9e95-7c5e29756adc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:00.855159 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4cd88fce-b9c1-4947-9e95-7c5e29756adc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:00.857424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4cd88fce-b9c1-4947-9e95-7c5e29756adc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:00.859060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4cd88fce-b9c1-4947-9e95-7c5e29756adc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.216183 Jun 23 16:02:00.866889 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 90/174] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:02:00 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:02:01.169983 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1ae40c35-52d7-4333-880d-dd574ac69c51 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:01.170506 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1ae40c35-52d7-4333-880d-dd574ac69c51 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:01.182786 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ae40c35-52d7-4333-880d-dd574ac69c51 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:01.187303 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ae40c35-52d7-4333-880d-dd574ac69c51 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:01.188140 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ae40c35-52d7-4333-880d-dd574ac69c51 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:01.188569 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ae40c35-52d7-4333-880d-dd574ac69c51 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:01.392346 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1ae40c35-52d7-4333-880d-dd574ac69c51 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:01.401816 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1ae40c35-52d7-4333-880d-dd574ac69c51 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.235957 Jun 23 16:02:01.403048 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 85/175] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:01 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:01.427423 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-66496249-0360-4b00-8882-2d5d703f5a07 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:01.428622 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-66496249-0360-4b00-8882-2d5d703f5a07 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:01.441073 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-66496249-0360-4b00-8882-2d5d703f5a07 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:01.442233 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-66496249-0360-4b00-8882-2d5d703f5a07 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:01.443725 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-66496249-0360-4b00-8882-2d5d703f5a07 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:01.445434 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-66496249-0360-4b00-8882-2d5d703f5a07 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:01.660421 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-66496249-0360-4b00-8882-2d5d703f5a07 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:01.670077 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-66496249-0360-4b00-8882-2d5d703f5a07 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.248986 Jun 23 16:02:01.670840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 91/176] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:01 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:01.878823 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2f9f091b-29d1-45c0-abdf-241e0aa072dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:01.879559 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2f9f091b-29d1-45c0-abdf-241e0aa072dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:01.889494 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f9f091b-29d1-45c0-abdf-241e0aa072dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:01.890287 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f9f091b-29d1-45c0-abdf-241e0aa072dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:01.891324 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f9f091b-29d1-45c0-abdf-241e0aa072dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:01.891964 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f9f091b-29d1-45c0-abdf-241e0aa072dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:02.154042 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2f9f091b-29d1-45c0-abdf-241e0aa072dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:02.164847 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2f9f091b-29d1-45c0-abdf-241e0aa072dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:02.166651 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2f9f091b-29d1-45c0-abdf-241e0aa072dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:02.167958 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2f9f091b-29d1-45c0-abdf-241e0aa072dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.294091 Jun 23 16:02:02.168663 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 86/177] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:02:01 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:02:02.428570 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ac4a7201-605f-4899-80a2-75bc0cf85a82 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:02.430486 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ac4a7201-605f-4899-80a2-75bc0cf85a82 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:02.438478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac4a7201-605f-4899-80a2-75bc0cf85a82 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:02.438984 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac4a7201-605f-4899-80a2-75bc0cf85a82 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:02.439817 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac4a7201-605f-4899-80a2-75bc0cf85a82 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:02.440248 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ac4a7201-605f-4899-80a2-75bc0cf85a82 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:02.673341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ac4a7201-605f-4899-80a2-75bc0cf85a82 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:02.683612 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ac4a7201-605f-4899-80a2-75bc0cf85a82 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.258816 Jun 23 16:02:02.699283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 92/178] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:02 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:02.700369 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-82a550a8-7b11-4abf-be66-6a9818bd5e9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:02.703524 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-82a550a8-7b11-4abf-be66-6a9818bd5e9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:02.719200 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82a550a8-7b11-4abf-be66-6a9818bd5e9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:02.720048 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82a550a8-7b11-4abf-be66-6a9818bd5e9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:02.721913 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82a550a8-7b11-4abf-be66-6a9818bd5e9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:02.723136 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82a550a8-7b11-4abf-be66-6a9818bd5e9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:02.952524 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-82a550a8-7b11-4abf-be66-6a9818bd5e9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:02.971870 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-82a550a8-7b11-4abf-be66-6a9818bd5e9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.282010 Jun 23 16:02:02.978770 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 87/179] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:02 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:03.190611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a21026b9-5704-4007-8c1d-bd02411301d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:03.191749 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a21026b9-5704-4007-8c1d-bd02411301d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:03.203104 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a21026b9-5704-4007-8c1d-bd02411301d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:03.203845 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a21026b9-5704-4007-8c1d-bd02411301d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:03.205226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a21026b9-5704-4007-8c1d-bd02411301d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:03.205960 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a21026b9-5704-4007-8c1d-bd02411301d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:03.412703 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a21026b9-5704-4007-8c1d-bd02411301d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:03.431405 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a21026b9-5704-4007-8c1d-bd02411301d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:03.436040 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a21026b9-5704-4007-8c1d-bd02411301d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:03.438298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a21026b9-5704-4007-8c1d-bd02411301d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.255929 Jun 23 16:02:03.439861 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 93/180] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:02:03 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:02:03.709355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e48f0dec-e293-4e96-a700-c97802b4bc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:03.709998 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e48f0dec-e293-4e96-a700-c97802b4bc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:03.717138 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e48f0dec-e293-4e96-a700-c97802b4bc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:03.717588 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e48f0dec-e293-4e96-a700-c97802b4bc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:03.718375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e48f0dec-e293-4e96-a700-c97802b4bc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:03.718839 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e48f0dec-e293-4e96-a700-c97802b4bc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:03.723358 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:03.895085 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e48f0dec-e293-4e96-a700-c97802b4bc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:03.915190 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e48f0dec-e293-4e96-a700-c97802b4bc64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.208524 Jun 23 16:02:03.928414 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 88/181] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:03 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:03.989686 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-492722ef-a1d6-4782-b624-507abdae32d2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:03.990427 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-492722ef-a1d6-4782-b624-507abdae32d2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:03.998277 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-492722ef-a1d6-4782-b624-507abdae32d2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:03.999249 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-492722ef-a1d6-4782-b624-507abdae32d2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:04.000236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-492722ef-a1d6-4782-b624-507abdae32d2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:04.000844 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-492722ef-a1d6-4782-b624-507abdae32d2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:04.004537 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:04.219586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-492722ef-a1d6-4782-b624-507abdae32d2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:04.232848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-492722ef-a1d6-4782-b624-507abdae32d2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1322 microversion: 2.1 time: 0.246665 Jun 23 16:02:04.233711 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 94/182] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:03 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:04.461577 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-44916b4a-f6c0-4e82-a7eb-e93267f75854 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:04.462647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-44916b4a-f6c0-4e82-a7eb-e93267f75854 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:04.473807 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44916b4a-f6c0-4e82-a7eb-e93267f75854 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:04.474581 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44916b4a-f6c0-4e82-a7eb-e93267f75854 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:04.475730 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44916b4a-f6c0-4e82-a7eb-e93267f75854 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:04.476302 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44916b4a-f6c0-4e82-a7eb-e93267f75854 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:04.637356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-15ea6ba3-403d-4fb8-8664-098f6c69defd req-d6ce280c-1765-42b3-9419-9fda9c3c5dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa6e984-d2b4-48ea-b887-250c0935b0be", "name": "network-vif-plugged", "status": "completed", "tag": "ab7781e0-6518-45fd-8136-cb944ebb585a"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:02:04.649817 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-15ea6ba3-403d-4fb8-8664-098f6c69defd req-d6ce280c-1765-42b3-9419-9fda9c3c5dd9 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:04.650755 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-15ea6ba3-403d-4fb8-8664-098f6c69defd req-d6ce280c-1765-42b3-9419-9fda9c3c5dd9 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:04.664057 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-15ea6ba3-403d-4fb8-8664-098f6c69defd req-d6ce280c-1765-42b3-9419-9fda9c3c5dd9 service nova] Creating event network-vif-plugged:ab7781e0-6518-45fd-8136-cb944ebb585a for instance 0aa6e984-d2b4-48ea-b887-250c0935b0be on hv-cinder-83538 Jun 23 16:02:04.670231 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-15ea6ba3-403d-4fb8-8664-098f6c69defd req-d6ce280c-1765-42b3-9419-9fda9c3c5dd9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038510 Jun 23 16:02:04.671048 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 95/183] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:02:04.743703 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-44916b4a-f6c0-4e82-a7eb-e93267f75854 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:04.757524 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-44916b4a-f6c0-4e82-a7eb-e93267f75854 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:04.762382 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-44916b4a-f6c0-4e82-a7eb-e93267f75854 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:04.764164 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-44916b4a-f6c0-4e82-a7eb-e93267f75854 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.309985 Jun 23 16:02:04.765519 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 89/184] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:02:04 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:02:04.942233 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-96dff95d-ebd5-4739-9397-27086d40f772 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:04.943046 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-96dff95d-ebd5-4739-9397-27086d40f772 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:04.950195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96dff95d-ebd5-4739-9397-27086d40f772 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:04.950641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96dff95d-ebd5-4739-9397-27086d40f772 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:04.951530 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96dff95d-ebd5-4739-9397-27086d40f772 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:04.952146 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96dff95d-ebd5-4739-9397-27086d40f772 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:05.190500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-96dff95d-ebd5-4739-9397-27086d40f772 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:05.216637 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-96dff95d-ebd5-4739-9397-27086d40f772 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.278291 Jun 23 16:02:05.217548 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 96/185] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:04 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:05.255665 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e5a8183b-a553-47bb-ac9f-3a6d30059e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:05.256828 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e5a8183b-a553-47bb-ac9f-3a6d30059e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:05.270252 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5a8183b-a553-47bb-ac9f-3a6d30059e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:05.271028 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5a8183b-a553-47bb-ac9f-3a6d30059e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:05.272534 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5a8183b-a553-47bb-ac9f-3a6d30059e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:05.273274 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e5a8183b-a553-47bb-ac9f-3a6d30059e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:05.526618 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e5a8183b-a553-47bb-ac9f-3a6d30059e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:05.538020 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e5a8183b-a553-47bb-ac9f-3a6d30059e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1515 microversion: 2.1 time: 0.288783 Jun 23 16:02:05.539458 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 90/186] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:05 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1515 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:05.574541 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ae63a946-2309-47bf-a905-be9212f9de6c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:02:05.576464 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ae63a946-2309-47bf-a905-be9212f9de6c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:05.588570 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae63a946-2309-47bf-a905-be9212f9de6c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:05.589305 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae63a946-2309-47bf-a905-be9212f9de6c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:05.590760 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae63a946-2309-47bf-a905-be9212f9de6c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:05.591429 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ae63a946-2309-47bf-a905-be9212f9de6c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:05.644631 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-ae63a946-2309-47bf-a905-be9212f9de6c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lazy-loading 'flavor' on Instance uuid 777072f3-db6b-4c68-8fbb-e300170a00b8 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:02:05.795043 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-53080aba-1868-4866-bb8a-5f1455ec3e7b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:05.795043 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-53080aba-1868-4866-bb8a-5f1455ec3e7b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:05.833757 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53080aba-1868-4866-bb8a-5f1455ec3e7b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:05.834527 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53080aba-1868-4866-bb8a-5f1455ec3e7b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:05.835704 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53080aba-1868-4866-bb8a-5f1455ec3e7b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:05.836336 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-53080aba-1868-4866-bb8a-5f1455ec3e7b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:05.894304 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ae63a946-2309-47bf-a905-be9212f9de6c tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8/action" status: 200 len: 32 microversion: 2.1 time: 0.332659 Jun 23 16:02:05.895263 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 97/187] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:02:05 2022] POST /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8/action => generated 32 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 16:02:05.906287 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7cc1affb-7c77-42c1-80d9-51e10a565a6b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:05.910405 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7cc1affb-7c77-42c1-80d9-51e10a565a6b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:05.915452 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7cc1affb-7c77-42c1-80d9-51e10a565a6b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:05.915921 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7cc1affb-7c77-42c1-80d9-51e10a565a6b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:05.916692 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7cc1affb-7c77-42c1-80d9-51e10a565a6b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:05.917129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7cc1affb-7c77-42c1-80d9-51e10a565a6b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:06.113113 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7cc1affb-7c77-42c1-80d9-51e10a565a6b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:06.131417 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7cc1affb-7c77-42c1-80d9-51e10a565a6b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.229926 Jun 23 16:02:06.133383 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 98/188] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:05 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:06.173477 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-53080aba-1868-4866-bb8a-5f1455ec3e7b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:06.183565 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-53080aba-1868-4866-bb8a-5f1455ec3e7b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:06.185690 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-53080aba-1868-4866-bb8a-5f1455ec3e7b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:06.187142 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-53080aba-1868-4866-bb8a-5f1455ec3e7b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.402963 Jun 23 16:02:06.188050 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 91/189] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:02:05 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:02:06.247440 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4b81a6d9-5fb6-46dd-9113-76e6b3a42100 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:06.248725 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4b81a6d9-5fb6-46dd-9113-76e6b3a42100 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:06.285412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4b81a6d9-5fb6-46dd-9113-76e6b3a42100 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:06.286834 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4b81a6d9-5fb6-46dd-9113-76e6b3a42100 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:06.288544 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4b81a6d9-5fb6-46dd-9113-76e6b3a42100 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:06.291699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4b81a6d9-5fb6-46dd-9113-76e6b3a42100 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:06.538807 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4b81a6d9-5fb6-46dd-9113-76e6b3a42100 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:06.546752 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4b81a6d9-5fb6-46dd-9113-76e6b3a42100 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.308336 Jun 23 16:02:06.547576 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 99/190] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:06 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:07.165027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dc01fa68-0d2d-4a1e-90d0-759af46fbb15 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:07.167235 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dc01fa68-0d2d-4a1e-90d0-759af46fbb15 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:07.180518 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc01fa68-0d2d-4a1e-90d0-759af46fbb15 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:07.181589 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc01fa68-0d2d-4a1e-90d0-759af46fbb15 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:07.183246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc01fa68-0d2d-4a1e-90d0-759af46fbb15 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:07.184233 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc01fa68-0d2d-4a1e-90d0-759af46fbb15 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:07.220150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f5af5794-a24b-49ff-9f05-14bdd80d50c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:07.222235 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f5af5794-a24b-49ff-9f05-14bdd80d50c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:07.235487 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5af5794-a24b-49ff-9f05-14bdd80d50c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:07.236873 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5af5794-a24b-49ff-9f05-14bdd80d50c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:07.238880 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5af5794-a24b-49ff-9f05-14bdd80d50c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:07.240269 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5af5794-a24b-49ff-9f05-14bdd80d50c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:07.452286 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dc01fa68-0d2d-4a1e-90d0-759af46fbb15 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:07.461641 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dc01fa68-0d2d-4a1e-90d0-759af46fbb15 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.307111 Jun 23 16:02:07.468820 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f5af5794-a24b-49ff-9f05-14bdd80d50c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:07.471460 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 92/191] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:07 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:07.478423 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f5af5794-a24b-49ff-9f05-14bdd80d50c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:07.480126 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f5af5794-a24b-49ff-9f05-14bdd80d50c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:07.481824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f5af5794-a24b-49ff-9f05-14bdd80d50c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.269032 Jun 23 16:02:07.482457 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 100/192] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:02:07 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:02:07.572078 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2498478a-893e-4a57-9083-7e59c48c5bb1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:07.572715 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2498478a-893e-4a57-9083-7e59c48c5bb1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:07.580044 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2498478a-893e-4a57-9083-7e59c48c5bb1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:07.580485 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2498478a-893e-4a57-9083-7e59c48c5bb1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:07.581472 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2498478a-893e-4a57-9083-7e59c48c5bb1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:07.581912 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2498478a-893e-4a57-9083-7e59c48c5bb1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:07.760518 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2498478a-893e-4a57-9083-7e59c48c5bb1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:07.774935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2498478a-893e-4a57-9083-7e59c48c5bb1 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.212022 Jun 23 16:02:07.777010 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 93/193] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:07 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:08.479106 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-71507b8f-2933-47e2-8631-60eb13e91785 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:08.479797 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-71507b8f-2933-47e2-8631-60eb13e91785 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:08.486575 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-71507b8f-2933-47e2-8631-60eb13e91785 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:08.487063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-71507b8f-2933-47e2-8631-60eb13e91785 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:08.487879 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-71507b8f-2933-47e2-8631-60eb13e91785 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:08.488317 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-71507b8f-2933-47e2-8631-60eb13e91785 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:08.501473 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e63d788c-bf23-4b9e-9b6b-5c072605cbcd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:08.502526 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e63d788c-bf23-4b9e-9b6b-5c072605cbcd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:08.509982 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e63d788c-bf23-4b9e-9b6b-5c072605cbcd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:08.510434 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e63d788c-bf23-4b9e-9b6b-5c072605cbcd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:08.511270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e63d788c-bf23-4b9e-9b6b-5c072605cbcd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:08.511698 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e63d788c-bf23-4b9e-9b6b-5c072605cbcd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:08.661340 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-71507b8f-2933-47e2-8631-60eb13e91785 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:08.677093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-71507b8f-2933-47e2-8631-60eb13e91785 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.201219 Jun 23 16:02:08.678560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 101/194] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:08 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:08.783377 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e63d788c-bf23-4b9e-9b6b-5c072605cbcd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:08.792432 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e63d788c-bf23-4b9e-9b6b-5c072605cbcd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:08.794124 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e63d788c-bf23-4b9e-9b6b-5c072605cbcd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:08.795391 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e63d788c-bf23-4b9e-9b6b-5c072605cbcd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.298986 Jun 23 16:02:08.796291 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 94/195] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:02:08 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:02:08.808586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0f183924-6a48-46f0-84fe-bbbee3bd7705 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:08.811582 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0f183924-6a48-46f0-84fe-bbbee3bd7705 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:08.818232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0f183924-6a48-46f0-84fe-bbbee3bd7705 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:08.818683 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0f183924-6a48-46f0-84fe-bbbee3bd7705 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:08.819534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0f183924-6a48-46f0-84fe-bbbee3bd7705 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:08.819970 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0f183924-6a48-46f0-84fe-bbbee3bd7705 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:08.997144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0f183924-6a48-46f0-84fe-bbbee3bd7705 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:09.012430 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0f183924-6a48-46f0-84fe-bbbee3bd7705 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.212032 Jun 23 16:02:09.013566 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 102/196] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:08 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:09.698891 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9480ebee-b136-48e2-90e2-0fbb92cf13fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:09.700549 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9480ebee-b136-48e2-90e2-0fbb92cf13fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:09.713971 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9480ebee-b136-48e2-90e2-0fbb92cf13fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:09.715342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9480ebee-b136-48e2-90e2-0fbb92cf13fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:09.716660 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9480ebee-b136-48e2-90e2-0fbb92cf13fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:09.718367 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9480ebee-b136-48e2-90e2-0fbb92cf13fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:09.819753 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fc75bfab-e9a1-43c0-a337-18f44462d574 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:09.821318 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fc75bfab-e9a1-43c0-a337-18f44462d574 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:09.837624 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc75bfab-e9a1-43c0-a337-18f44462d574 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:09.839732 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc75bfab-e9a1-43c0-a337-18f44462d574 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:09.841152 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc75bfab-e9a1-43c0-a337-18f44462d574 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:09.842551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fc75bfab-e9a1-43c0-a337-18f44462d574 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:09.950521 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9480ebee-b136-48e2-90e2-0fbb92cf13fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:09.964653 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9480ebee-b136-48e2-90e2-0fbb92cf13fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.272113 Jun 23 16:02:09.966923 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 95/197] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:09 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:10.040263 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1c72242d-94b5-4588-b447-d323036054ce tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:10.041151 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1c72242d-94b5-4588-b447-d323036054ce tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:10.048665 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1c72242d-94b5-4588-b447-d323036054ce tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:10.049420 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1c72242d-94b5-4588-b447-d323036054ce tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:10.050478 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1c72242d-94b5-4588-b447-d323036054ce tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:10.050934 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1c72242d-94b5-4588-b447-d323036054ce tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:10.058717 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fc75bfab-e9a1-43c0-a337-18f44462d574 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:10.072358 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fc75bfab-e9a1-43c0-a337-18f44462d574 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:10.073972 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fc75bfab-e9a1-43c0-a337-18f44462d574 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:10.075220 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fc75bfab-e9a1-43c0-a337-18f44462d574 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1406 microversion: 2.20 time: 0.264514 Jun 23 16:02:10.075785 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 103/198] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:02:09 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:02:10.237549 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1c72242d-94b5-4588-b447-d323036054ce tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:10.246446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1c72242d-94b5-4588-b447-d323036054ce tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.210037 Jun 23 16:02:10.247205 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 96/199] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:10 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:10.986182 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-905c9ac1-a3cd-4c76-bf6f-5b241b924279 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:10.987897 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-905c9ac1-a3cd-4c76-bf6f-5b241b924279 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:10.996633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-905c9ac1-a3cd-4c76-bf6f-5b241b924279 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:10.997413 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-905c9ac1-a3cd-4c76-bf6f-5b241b924279 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:10.998420 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-905c9ac1-a3cd-4c76-bf6f-5b241b924279 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:10.999081 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-905c9ac1-a3cd-4c76-bf6f-5b241b924279 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:11.093294 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f3b240d9-1271-4d84-92b0-cd364a2d65ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:11.094563 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f3b240d9-1271-4d84-92b0-cd364a2d65ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:11.105572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3b240d9-1271-4d84-92b0-cd364a2d65ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:11.107709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3b240d9-1271-4d84-92b0-cd364a2d65ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:11.108094 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3b240d9-1271-4d84-92b0-cd364a2d65ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:11.108540 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3b240d9-1271-4d84-92b0-cd364a2d65ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:11.199597 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-905c9ac1-a3cd-4c76-bf6f-5b241b924279 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:11.211842 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-905c9ac1-a3cd-4c76-bf6f-5b241b924279 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.231053 Jun 23 16:02:11.223136 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 104/200] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:10 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:11.263902 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dcec3a11-38c7-4a01-9b3b-792736dcbad8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:11.264755 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-dcec3a11-38c7-4a01-9b3b-792736dcbad8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:11.271069 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dcec3a11-38c7-4a01-9b3b-792736dcbad8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:11.271595 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dcec3a11-38c7-4a01-9b3b-792736dcbad8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:11.272429 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dcec3a11-38c7-4a01-9b3b-792736dcbad8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:11.272926 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dcec3a11-38c7-4a01-9b3b-792736dcbad8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:11.287321 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f3b240d9-1271-4d84-92b0-cd364a2d65ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:11.303976 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f3b240d9-1271-4d84-92b0-cd364a2d65ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:11.306184 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f3b240d9-1271-4d84-92b0-cd364a2d65ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:11.307390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f3b240d9-1271-4d84-92b0-cd364a2d65ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1598 microversion: 2.20 time: 0.217930 Jun 23 16:02:11.315454 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 97/201] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:02:11 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1598 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:02:11.338142 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-204eeb12-be7b-472f-a63f-e06a138f0565 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:11.339139 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-204eeb12-be7b-472f-a63f-e06a138f0565 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:11.349128 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-204eeb12-be7b-472f-a63f-e06a138f0565 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:11.349897 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-204eeb12-be7b-472f-a63f-e06a138f0565 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:11.351903 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-204eeb12-be7b-472f-a63f-e06a138f0565 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:11.353124 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-204eeb12-be7b-472f-a63f-e06a138f0565 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:11.441563 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-dcec3a11-38c7-4a01-9b3b-792736dcbad8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:11.450500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-dcec3a11-38c7-4a01-9b3b-792736dcbad8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.190139 Jun 23 16:02:11.451170 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 105/202] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:11 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:11.501149 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-204eeb12-be7b-472f-a63f-e06a138f0565 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.171230 Jun 23 16:02:11.501826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 98/203] 10.222.0.46 () {60 vars in 1315 bytes} [Thu Jun 23 16:02:11 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 16:02:12.229989 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-74cb6d16-56b6-4ca6-bd9f-00f1ea7b5e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:12.230562 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-74cb6d16-56b6-4ca6-bd9f-00f1ea7b5e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:12.238269 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-74cb6d16-56b6-4ca6-bd9f-00f1ea7b5e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:12.238988 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-74cb6d16-56b6-4ca6-bd9f-00f1ea7b5e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:12.239901 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-74cb6d16-56b6-4ca6-bd9f-00f1ea7b5e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:12.240557 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-74cb6d16-56b6-4ca6-bd9f-00f1ea7b5e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:12.470888 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5b199bac-50ff-45dc-8a4d-9a4b6000f9ec tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:12.471639 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5b199bac-50ff-45dc-8a4d-9a4b6000f9ec tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:12.479890 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b199bac-50ff-45dc-8a4d-9a4b6000f9ec tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:12.480454 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b199bac-50ff-45dc-8a4d-9a4b6000f9ec tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:12.481379 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b199bac-50ff-45dc-8a4d-9a4b6000f9ec tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:12.481968 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b199bac-50ff-45dc-8a4d-9a4b6000f9ec tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:12.539430 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-74cb6d16-56b6-4ca6-bd9f-00f1ea7b5e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:12.548438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-74cb6d16-56b6-4ca6-bd9f-00f1ea7b5e33 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.322806 Jun 23 16:02:12.549898 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 106/204] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:12 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:12.640500 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5b199bac-50ff-45dc-8a4d-9a4b6000f9ec tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:12.649052 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5b199bac-50ff-45dc-8a4d-9a4b6000f9ec tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.183227 Jun 23 16:02:12.649635 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 99/205] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:12 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:12.963908 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-a72a387a-7b4b-418f-af0f-cc8073822a4f req-3260b369-e6d2-485a-a820-a9c3f5eec880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14021a2e-8af8-4292-996e-ea87ff7752e0", "tag": "15db635b-5851-4528-8f58-f9ba091f51a6"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:02:12.972489 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-a72a387a-7b4b-418f-af0f-cc8073822a4f req-3260b369-e6d2-485a-a820-a9c3f5eec880 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:12.973034 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-a72a387a-7b4b-418f-af0f-cc8073822a4f req-3260b369-e6d2-485a-a820-a9c3f5eec880 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:12.990944 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-a72a387a-7b4b-418f-af0f-cc8073822a4f req-3260b369-e6d2-485a-a820-a9c3f5eec880 service nova] Creating event network-changed:15db635b-5851-4528-8f58-f9ba091f51a6 for instance 14021a2e-8af8-4292-996e-ea87ff7752e0 on hv-cinder-83538 Jun 23 16:02:12.997877 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-a72a387a-7b4b-418f-af0f-cc8073822a4f req-3260b369-e6d2-485a-a820-a9c3f5eec880 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036873 Jun 23 16:02:12.998870 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 107/206] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:02:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:02:13.566721 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5411d100-38bb-4e4a-8855-d1ba6558f0f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:13.567505 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5411d100-38bb-4e4a-8855-d1ba6558f0f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:13.575135 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5411d100-38bb-4e4a-8855-d1ba6558f0f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:13.575925 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5411d100-38bb-4e4a-8855-d1ba6558f0f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:13.577569 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5411d100-38bb-4e4a-8855-d1ba6558f0f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:13.578229 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5411d100-38bb-4e4a-8855-d1ba6558f0f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:13.667651 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-82f8590b-bc77-48da-9e0e-22df1799a379 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:13.668342 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-82f8590b-bc77-48da-9e0e-22df1799a379 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:13.674912 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82f8590b-bc77-48da-9e0e-22df1799a379 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:13.675636 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82f8590b-bc77-48da-9e0e-22df1799a379 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:13.676630 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82f8590b-bc77-48da-9e0e-22df1799a379 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:13.677065 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82f8590b-bc77-48da-9e0e-22df1799a379 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:13.747525 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5411d100-38bb-4e4a-8855-d1ba6558f0f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:13.758316 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5411d100-38bb-4e4a-8855-d1ba6558f0f2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.195999 Jun 23 16:02:13.758937 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 100/207] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:13 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:13.855904 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-82f8590b-bc77-48da-9e0e-22df1799a379 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:13.863421 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-82f8590b-bc77-48da-9e0e-22df1799a379 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.201085 Jun 23 16:02:13.864000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 108/208] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:13 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:14.777450 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-08d94368-f8a7-40cf-8f90-0695c1f8161b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:14.778859 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-08d94368-f8a7-40cf-8f90-0695c1f8161b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:14.785024 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-08d94368-f8a7-40cf-8f90-0695c1f8161b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:14.785556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-08d94368-f8a7-40cf-8f90-0695c1f8161b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:14.786399 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-08d94368-f8a7-40cf-8f90-0695c1f8161b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:14.786964 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-08d94368-f8a7-40cf-8f90-0695c1f8161b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:14.886411 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-633e1d62-64e6-43c2-8fea-984d6285f765 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:14.887184 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-633e1d62-64e6-43c2-8fea-984d6285f765 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:14.895172 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-633e1d62-64e6-43c2-8fea-984d6285f765 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:14.895629 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-633e1d62-64e6-43c2-8fea-984d6285f765 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:14.896410 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-633e1d62-64e6-43c2-8fea-984d6285f765 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:14.896847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-633e1d62-64e6-43c2-8fea-984d6285f765 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:14.942332 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-08d94368-f8a7-40cf-8f90-0695c1f8161b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:14.952027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-08d94368-f8a7-40cf-8f90-0695c1f8161b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.179541 Jun 23 16:02:14.952612 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 101/209] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:14 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:15.254639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-633e1d62-64e6-43c2-8fea-984d6285f765 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:15.262968 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-633e1d62-64e6-43c2-8fea-984d6285f765 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.386343 Jun 23 16:02:15.263692 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 109/210] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:14 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:15.971594 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-824f1aad-06de-4dc1-b10c-d3ab242a9545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:15.971594 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-824f1aad-06de-4dc1-b10c-d3ab242a9545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:15.975886 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-824f1aad-06de-4dc1-b10c-d3ab242a9545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:15.976335 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-824f1aad-06de-4dc1-b10c-d3ab242a9545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:15.977096 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-824f1aad-06de-4dc1-b10c-d3ab242a9545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:15.977523 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-824f1aad-06de-4dc1-b10c-d3ab242a9545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:16.147585 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-824f1aad-06de-4dc1-b10c-d3ab242a9545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:16.162189 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-824f1aad-06de-4dc1-b10c-d3ab242a9545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.196075 Jun 23 16:02:16.163272 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 102/211] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:15 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:16.287516 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a82657d8-2cd6-44e1-84f5-08ee0c22294f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:16.288893 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a82657d8-2cd6-44e1-84f5-08ee0c22294f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:16.292091 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=72 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:16.299001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a82657d8-2cd6-44e1-84f5-08ee0c22294f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:16.299912 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a82657d8-2cd6-44e1-84f5-08ee0c22294f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:16.300702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a82657d8-2cd6-44e1-84f5-08ee0c22294f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:16.301138 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a82657d8-2cd6-44e1-84f5-08ee0c22294f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:16.304921 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:16.457282 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a82657d8-2cd6-44e1-84f5-08ee0c22294f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:16.465563 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a82657d8-2cd6-44e1-84f5-08ee0c22294f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.182542 Jun 23 16:02:16.466164 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 110/212] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:16 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:17.185781 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-51d7e7c7-669b-4c0f-a8d3-8bf83d28af9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:17.186384 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-51d7e7c7-669b-4c0f-a8d3-8bf83d28af9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:17.192751 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51d7e7c7-669b-4c0f-a8d3-8bf83d28af9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:17.193387 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51d7e7c7-669b-4c0f-a8d3-8bf83d28af9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:17.194140 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51d7e7c7-669b-4c0f-a8d3-8bf83d28af9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:17.194725 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51d7e7c7-669b-4c0f-a8d3-8bf83d28af9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:17.337843 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-51d7e7c7-669b-4c0f-a8d3-8bf83d28af9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:17.345794 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-51d7e7c7-669b-4c0f-a8d3-8bf83d28af9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.163740 Jun 23 16:02:17.346897 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 103/213] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:17 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:17.483731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-561f3c27-afdf-42d0-bbac-b57579fc0119 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:17.484527 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-561f3c27-afdf-42d0-bbac-b57579fc0119 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:17.492362 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-561f3c27-afdf-42d0-bbac-b57579fc0119 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:17.493593 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-561f3c27-afdf-42d0-bbac-b57579fc0119 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:17.494467 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-561f3c27-afdf-42d0-bbac-b57579fc0119 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:17.495029 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-561f3c27-afdf-42d0-bbac-b57579fc0119 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:17.635249 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-561f3c27-afdf-42d0-bbac-b57579fc0119 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:17.644783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-561f3c27-afdf-42d0-bbac-b57579fc0119 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.165352 Jun 23 16:02:17.645355 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 111/214] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:17 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:18.367607 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e3d0d8c7-c4e3-482e-a3ee-e63f4c983302 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:18.368799 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e3d0d8c7-c4e3-482e-a3ee-e63f4c983302 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:18.375639 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e3d0d8c7-c4e3-482e-a3ee-e63f4c983302 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:18.376083 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e3d0d8c7-c4e3-482e-a3ee-e63f4c983302 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:18.376914 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e3d0d8c7-c4e3-482e-a3ee-e63f4c983302 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:18.377337 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e3d0d8c7-c4e3-482e-a3ee-e63f4c983302 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:18.528068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e3d0d8c7-c4e3-482e-a3ee-e63f4c983302 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:18.536809 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e3d0d8c7-c4e3-482e-a3ee-e63f4c983302 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.172916 Jun 23 16:02:18.537575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 104/215] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:18 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:18.662875 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fd31a324-3db9-4543-91f7-7072a1f105cd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:18.663520 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fd31a324-3db9-4543-91f7-7072a1f105cd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:18.670185 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd31a324-3db9-4543-91f7-7072a1f105cd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:18.670628 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd31a324-3db9-4543-91f7-7072a1f105cd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:18.671617 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd31a324-3db9-4543-91f7-7072a1f105cd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:18.672038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd31a324-3db9-4543-91f7-7072a1f105cd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:18.817482 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fd31a324-3db9-4543-91f7-7072a1f105cd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:18.825195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fd31a324-3db9-4543-91f7-7072a1f105cd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.166230 Jun 23 16:02:18.825916 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 112/216] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:18 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:19.554107 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7916a4e0-9fef-43fd-bc9c-48617b9c8665 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:19.555029 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7916a4e0-9fef-43fd-bc9c-48617b9c8665 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:19.560589 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=78 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:19.563722 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7916a4e0-9fef-43fd-bc9c-48617b9c8665 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:19.564256 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7916a4e0-9fef-43fd-bc9c-48617b9c8665 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:19.565289 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7916a4e0-9fef-43fd-bc9c-48617b9c8665 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:19.565804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7916a4e0-9fef-43fd-bc9c-48617b9c8665 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:19.572801 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:19.713117 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7916a4e0-9fef-43fd-bc9c-48617b9c8665 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:19.720647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7916a4e0-9fef-43fd-bc9c-48617b9c8665 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.170694 Jun 23 16:02:19.721238 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 105/217] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:19 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:19.843786 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d496b6be-21f2-4424-864a-d8db3a9b3683 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:19.844450 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d496b6be-21f2-4424-864a-d8db3a9b3683 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:19.851416 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d496b6be-21f2-4424-864a-d8db3a9b3683 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:19.851854 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d496b6be-21f2-4424-864a-d8db3a9b3683 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:19.852618 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d496b6be-21f2-4424-864a-d8db3a9b3683 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:19.853048 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d496b6be-21f2-4424-864a-d8db3a9b3683 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:19.988277 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d496b6be-21f2-4424-864a-d8db3a9b3683 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:19.996673 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d496b6be-21f2-4424-864a-d8db3a9b3683 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1368 microversion: 2.1 time: 0.156659 Jun 23 16:02:19.997196 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 113/218] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:19 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:20.737249 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0512685a-dfca-4abc-8839-590dc64faa09 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:20.737863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0512685a-dfca-4abc-8839-590dc64faa09 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:20.743721 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0512685a-dfca-4abc-8839-590dc64faa09 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:20.744169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0512685a-dfca-4abc-8839-590dc64faa09 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:20.744927 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0512685a-dfca-4abc-8839-590dc64faa09 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:20.745369 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0512685a-dfca-4abc-8839-590dc64faa09 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:20.898183 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0512685a-dfca-4abc-8839-590dc64faa09 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:20.908366 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0512685a-dfca-4abc-8839-590dc64faa09 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.174808 Jun 23 16:02:20.909124 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 106/219] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:20 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:21.018713 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-113ae277-6d07-4555-ad70-5cedea29e37f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:21.020133 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-113ae277-6d07-4555-ad70-5cedea29e37f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:21.033918 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-113ae277-6d07-4555-ad70-5cedea29e37f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:21.034648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-113ae277-6d07-4555-ad70-5cedea29e37f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:21.035938 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-113ae277-6d07-4555-ad70-5cedea29e37f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:21.036659 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-113ae277-6d07-4555-ad70-5cedea29e37f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:21.322562 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-113ae277-6d07-4555-ad70-5cedea29e37f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:21.330533 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-113ae277-6d07-4555-ad70-5cedea29e37f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1557 microversion: 2.1 time: 0.319409 Jun 23 16:02:21.331213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 114/220] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:21 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1557 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:21.349113 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4d468520-d033-4bdd-993f-cf81ae8b4fe2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:21.349607 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4d468520-d033-4bdd-993f-cf81ae8b4fe2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:21.355473 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d468520-d033-4bdd-993f-cf81ae8b4fe2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:21.356093 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d468520-d033-4bdd-993f-cf81ae8b4fe2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:21.356842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d468520-d033-4bdd-993f-cf81ae8b4fe2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:21.357270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d468520-d033-4bdd-993f-cf81ae8b4fe2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:21.439653 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4d468520-d033-4bdd-993f-cf81ae8b4fe2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094313 Jun 23 16:02:21.440335 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 107/221] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 23 16:02:21 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:02:21.935493 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c6d323fd-ce40-4ff1-9756-4b65f5f5bdcf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:21.936596 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c6d323fd-ce40-4ff1-9756-4b65f5f5bdcf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:21.943755 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6d323fd-ce40-4ff1-9756-4b65f5f5bdcf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:21.945091 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6d323fd-ce40-4ff1-9756-4b65f5f5bdcf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:21.945899 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6d323fd-ce40-4ff1-9756-4b65f5f5bdcf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:21.946899 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6d323fd-ce40-4ff1-9756-4b65f5f5bdcf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:22.193134 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c6d323fd-ce40-4ff1-9756-4b65f5f5bdcf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:22.200948 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c6d323fd-ce40-4ff1-9756-4b65f5f5bdcf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.269530 Jun 23 16:02:22.201625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 115/222] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:21 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:22.507932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-103c7320-4d27-4610-8cda-f3fe627c0b94 req-1b5557ce-1b71-4721-b05e-aa33a407cfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa6e984-d2b4-48ea-b887-250c0935b0be", "tag": "ab7781e0-6518-45fd-8136-cb944ebb585a"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:02:22.516925 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-103c7320-4d27-4610-8cda-f3fe627c0b94 req-1b5557ce-1b71-4721-b05e-aa33a407cfe6 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:22.517452 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-103c7320-4d27-4610-8cda-f3fe627c0b94 req-1b5557ce-1b71-4721-b05e-aa33a407cfe6 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:22.529618 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-103c7320-4d27-4610-8cda-f3fe627c0b94 req-1b5557ce-1b71-4721-b05e-aa33a407cfe6 service nova] Creating event network-changed:ab7781e0-6518-45fd-8136-cb944ebb585a for instance 0aa6e984-d2b4-48ea-b887-250c0935b0be on hv-cinder-83538 Jun 23 16:02:22.535110 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-103c7320-4d27-4610-8cda-f3fe627c0b94 req-1b5557ce-1b71-4721-b05e-aa33a407cfe6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030885 Jun 23 16:02:22.535708 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 108/223] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:02:23.218135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-287eab99-8514-4ccc-adae-911dacdc6abb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:23.218713 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-287eab99-8514-4ccc-adae-911dacdc6abb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:23.225119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-287eab99-8514-4ccc-adae-911dacdc6abb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:23.225565 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-287eab99-8514-4ccc-adae-911dacdc6abb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:23.226333 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-287eab99-8514-4ccc-adae-911dacdc6abb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:23.226829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-287eab99-8514-4ccc-adae-911dacdc6abb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:23.378522 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-287eab99-8514-4ccc-adae-911dacdc6abb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:23.389180 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-287eab99-8514-4ccc-adae-911dacdc6abb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.175009 Jun 23 16:02:23.389806 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 116/224] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:23 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:24.407911 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-30f5bb96-e22c-4312-b669-9e5fd5dd2e37 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:24.408621 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-30f5bb96-e22c-4312-b669-9e5fd5dd2e37 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:24.414919 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30f5bb96-e22c-4312-b669-9e5fd5dd2e37 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:24.415366 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30f5bb96-e22c-4312-b669-9e5fd5dd2e37 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:24.416148 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30f5bb96-e22c-4312-b669-9e5fd5dd2e37 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:24.416578 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-30f5bb96-e22c-4312-b669-9e5fd5dd2e37 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:24.550150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-30f5bb96-e22c-4312-b669-9e5fd5dd2e37 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:24.558872 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-30f5bb96-e22c-4312-b669-9e5fd5dd2e37 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.155154 Jun 23 16:02:24.559670 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 109/225] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:24 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:25.576277 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c1eade1c-d8c3-41bf-9f22-9fd9feb55fca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:25.576916 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c1eade1c-d8c3-41bf-9f22-9fd9feb55fca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:25.583475 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1eade1c-d8c3-41bf-9f22-9fd9feb55fca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:25.583921 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1eade1c-d8c3-41bf-9f22-9fd9feb55fca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:25.584685 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1eade1c-d8c3-41bf-9f22-9fd9feb55fca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:25.585122 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1eade1c-d8c3-41bf-9f22-9fd9feb55fca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:25.723332 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c1eade1c-d8c3-41bf-9f22-9fd9feb55fca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:25.730925 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c1eade1c-d8c3-41bf-9f22-9fd9feb55fca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.158471 Jun 23 16:02:25.731496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 117/226] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:25 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:26.747737 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-61d75310-f74d-4523-813e-2a82b23d4a69 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:26.748267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-61d75310-f74d-4523-813e-2a82b23d4a69 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:26.754209 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61d75310-f74d-4523-813e-2a82b23d4a69 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:26.754653 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61d75310-f74d-4523-813e-2a82b23d4a69 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:26.755437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61d75310-f74d-4523-813e-2a82b23d4a69 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:26.755873 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61d75310-f74d-4523-813e-2a82b23d4a69 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:26.884415 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-61d75310-f74d-4523-813e-2a82b23d4a69 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:26.892240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-61d75310-f74d-4523-813e-2a82b23d4a69 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.148318 Jun 23 16:02:26.892819 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 110/227] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:26 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:27.910128 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-eb025646-395d-4126-92e8-d70859352562 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:27.910757 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-eb025646-395d-4126-92e8-d70859352562 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:27.917756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eb025646-395d-4126-92e8-d70859352562 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:27.918189 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eb025646-395d-4126-92e8-d70859352562 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:27.919031 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eb025646-395d-4126-92e8-d70859352562 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:27.919460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eb025646-395d-4126-92e8-d70859352562 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:28.053475 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-eb025646-395d-4126-92e8-d70859352562 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:28.062001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-eb025646-395d-4126-92e8-d70859352562 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.155523 Jun 23 16:02:28.062571 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 118/228] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:27 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:29.079064 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-27e111ae-0921-4e6a-bd91-69606b2fe260 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:29.079678 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-27e111ae-0921-4e6a-bd91-69606b2fe260 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:29.087572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27e111ae-0921-4e6a-bd91-69606b2fe260 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:29.088014 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27e111ae-0921-4e6a-bd91-69606b2fe260 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:29.088806 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27e111ae-0921-4e6a-bd91-69606b2fe260 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:29.089239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27e111ae-0921-4e6a-bd91-69606b2fe260 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:29.238478 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-27e111ae-0921-4e6a-bd91-69606b2fe260 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:29.246721 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-27e111ae-0921-4e6a-bd91-69606b2fe260 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.171448 Jun 23 16:02:29.247292 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 111/229] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:29 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:30.264326 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cfa0040c-f889-4900-aa58-0c522f45578d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:30.264955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cfa0040c-f889-4900-aa58-0c522f45578d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:30.271499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cfa0040c-f889-4900-aa58-0c522f45578d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:30.271944 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cfa0040c-f889-4900-aa58-0c522f45578d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:30.272884 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cfa0040c-f889-4900-aa58-0c522f45578d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:30.273485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cfa0040c-f889-4900-aa58-0c522f45578d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:30.438623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cfa0040c-f889-4900-aa58-0c522f45578d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:30.448509 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cfa0040c-f889-4900-aa58-0c522f45578d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.186573 Jun 23 16:02:30.458870 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 119/230] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:30 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:31.470779 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0de9f524-175a-478d-b474-3cf953760eb8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:31.472405 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0de9f524-175a-478d-b474-3cf953760eb8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:31.481176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0de9f524-175a-478d-b474-3cf953760eb8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:31.481653 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0de9f524-175a-478d-b474-3cf953760eb8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:31.482635 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0de9f524-175a-478d-b474-3cf953760eb8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:31.483177 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0de9f524-175a-478d-b474-3cf953760eb8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:31.689180 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0de9f524-175a-478d-b474-3cf953760eb8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:31.699970 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0de9f524-175a-478d-b474-3cf953760eb8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.237529 Jun 23 16:02:31.700825 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 112/231] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:31 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:32.718333 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-418363f2-7705-4d28-8237-e4db172070f0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:32.719885 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-418363f2-7705-4d28-8237-e4db172070f0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:32.727178 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-418363f2-7705-4d28-8237-e4db172070f0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:32.727521 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-418363f2-7705-4d28-8237-e4db172070f0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:32.728362 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-418363f2-7705-4d28-8237-e4db172070f0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:32.728795 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-418363f2-7705-4d28-8237-e4db172070f0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:32.943552 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-418363f2-7705-4d28-8237-e4db172070f0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:32.958323 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-418363f2-7705-4d28-8237-e4db172070f0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.244238 Jun 23 16:02:32.958976 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 120/232] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:32 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:33.987564 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-041d4d74-a2c7-48e5-8430-fc679e23c4b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:33.988296 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-041d4d74-a2c7-48e5-8430-fc679e23c4b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:33.996671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-041d4d74-a2c7-48e5-8430-fc679e23c4b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:33.997250 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-041d4d74-a2c7-48e5-8430-fc679e23c4b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:33.998238 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-041d4d74-a2c7-48e5-8430-fc679e23c4b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:33.998863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-041d4d74-a2c7-48e5-8430-fc679e23c4b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:34.167572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-041d4d74-a2c7-48e5-8430-fc679e23c4b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:34.175640 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-041d4d74-a2c7-48e5-8430-fc679e23c4b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.197589 Jun 23 16:02:34.176334 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 113/233] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:33 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:35.196787 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a2816d8d-6b5b-4c2e-9668-26f91d1d7f61 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:35.197482 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a2816d8d-6b5b-4c2e-9668-26f91d1d7f61 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:35.210638 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2816d8d-6b5b-4c2e-9668-26f91d1d7f61 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:35.213289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2816d8d-6b5b-4c2e-9668-26f91d1d7f61 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:35.214257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2816d8d-6b5b-4c2e-9668-26f91d1d7f61 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:35.214894 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a2816d8d-6b5b-4c2e-9668-26f91d1d7f61 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:35.437551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a2816d8d-6b5b-4c2e-9668-26f91d1d7f61 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:35.446608 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a2816d8d-6b5b-4c2e-9668-26f91d1d7f61 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.256561 Jun 23 16:02:35.447418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 121/234] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:35 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:36.465538 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4a66895f-d08c-4610-a48f-685d2a0bc7b1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:36.466150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4a66895f-d08c-4610-a48f-685d2a0bc7b1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:36.473131 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a66895f-d08c-4610-a48f-685d2a0bc7b1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:36.473665 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a66895f-d08c-4610-a48f-685d2a0bc7b1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:36.474558 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a66895f-d08c-4610-a48f-685d2a0bc7b1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:36.475209 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a66895f-d08c-4610-a48f-685d2a0bc7b1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:36.630510 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4a66895f-d08c-4610-a48f-685d2a0bc7b1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:36.643058 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4a66895f-d08c-4610-a48f-685d2a0bc7b1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.182641 Jun 23 16:02:36.643647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 114/235] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:36 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:37.668848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9ca4a8cd-f4b0-4204-9fb2-5977bc7e926f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:37.669461 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9ca4a8cd-f4b0-4204-9fb2-5977bc7e926f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:37.676353 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ca4a8cd-f4b0-4204-9fb2-5977bc7e926f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:37.676804 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ca4a8cd-f4b0-4204-9fb2-5977bc7e926f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:37.677586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ca4a8cd-f4b0-4204-9fb2-5977bc7e926f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:37.678018 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ca4a8cd-f4b0-4204-9fb2-5977bc7e926f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:37.806875 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9ca4a8cd-f4b0-4204-9fb2-5977bc7e926f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:37.814379 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9ca4a8cd-f4b0-4204-9fb2-5977bc7e926f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.149360 Jun 23 16:02:37.814983 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 122/236] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:37 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:38.832268 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-85e87af9-59e5-4b52-a1fc-0917266d6bb5 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:38.832870 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-85e87af9-59e5-4b52-a1fc-0917266d6bb5 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:38.840192 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-85e87af9-59e5-4b52-a1fc-0917266d6bb5 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:38.840719 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-85e87af9-59e5-4b52-a1fc-0917266d6bb5 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:38.841747 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-85e87af9-59e5-4b52-a1fc-0917266d6bb5 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:38.842186 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-85e87af9-59e5-4b52-a1fc-0917266d6bb5 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:38.982451 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-85e87af9-59e5-4b52-a1fc-0917266d6bb5 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:38.990176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-85e87af9-59e5-4b52-a1fc-0917266d6bb5 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.161753 Jun 23 16:02:38.990773 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 115/237] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:38 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:39.886897 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6f5bd848-e0e0-4548-ba25-99a79ddc3a4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:39.887371 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6f5bd848-e0e0-4548-ba25-99a79ddc3a4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:39.895095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f5bd848-e0e0-4548-ba25-99a79ddc3a4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:39.895658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f5bd848-e0e0-4548-ba25-99a79ddc3a4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:39.896843 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f5bd848-e0e0-4548-ba25-99a79ddc3a4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:39.897286 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f5bd848-e0e0-4548-ba25-99a79ddc3a4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:39.926079 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6f5bd848-e0e0-4548-ba25-99a79ddc3a4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:02:40.008820 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7a6403cb-8dd8-48e8-b343-fe5d9f44d7f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:40.009448 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7a6403cb-8dd8-48e8-b343-fe5d9f44d7f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:40.016028 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a6403cb-8dd8-48e8-b343-fe5d9f44d7f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:40.016803 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a6403cb-8dd8-48e8-b343-fe5d9f44d7f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:40.017727 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a6403cb-8dd8-48e8-b343-fe5d9f44d7f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:40.018306 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a6403cb-8dd8-48e8-b343-fe5d9f44d7f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:40.043255 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6f5bd848-e0e0-4548-ba25-99a79ddc3a4b tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 204 len: 0 microversion: 2.1 time: 0.160107 Jun 23 16:02:40.044373 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 123/238] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:02:39 2022] DELETE /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 16:02:40.056774 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a3607115-aff5-4cbb-8c34-42368887f782 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:40.058104 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a3607115-aff5-4cbb-8c34-42368887f782 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:40.066586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a3607115-aff5-4cbb-8c34-42368887f782 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:40.067364 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a3607115-aff5-4cbb-8c34-42368887f782 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:40.068554 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a3607115-aff5-4cbb-8c34-42368887f782 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:40.069159 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a3607115-aff5-4cbb-8c34-42368887f782 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:40.171484 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7a6403cb-8dd8-48e8-b343-fe5d9f44d7f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:40.180601 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7a6403cb-8dd8-48e8-b343-fe5d9f44d7f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.176620 Jun 23 16:02:40.184002 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 116/239] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:40 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:40.256000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a3607115-aff5-4cbb-8c34-42368887f782 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:40.265134 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a3607115-aff5-4cbb-8c34-42368887f782 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1551 microversion: 2.1 time: 0.215182 Jun 23 16:02:40.265733 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 124/240] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:40 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1551 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:41.202040 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-46c15642-49e9-4f0f-9315-4b0742648fba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:41.202745 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-46c15642-49e9-4f0f-9315-4b0742648fba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:41.209140 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46c15642-49e9-4f0f-9315-4b0742648fba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:41.209671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46c15642-49e9-4f0f-9315-4b0742648fba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:41.210560 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46c15642-49e9-4f0f-9315-4b0742648fba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:41.211187 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-46c15642-49e9-4f0f-9315-4b0742648fba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:41.284094 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-90f39e1b-4699-4777-92fb-215f326cb7b5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:41.285271 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-90f39e1b-4699-4777-92fb-215f326cb7b5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:41.297072 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-90f39e1b-4699-4777-92fb-215f326cb7b5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:41.297793 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-90f39e1b-4699-4777-92fb-215f326cb7b5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:41.299536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-90f39e1b-4699-4777-92fb-215f326cb7b5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:41.307428 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-90f39e1b-4699-4777-92fb-215f326cb7b5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:41.335698 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:41.421509 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-46c15642-49e9-4f0f-9315-4b0742648fba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:41.438245 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-46c15642-49e9-4f0f-9315-4b0742648fba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.240299 Jun 23 16:02:41.439814 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 117/241] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:41 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:41.449640 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2104837171", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "networks": [{"uuid": "1a2e4d24-575a-4d10-8176-da6099ea152d"}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:02:41.496482 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-90f39e1b-4699-4777-92fb-215f326cb7b5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:41.506020 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-90f39e1b-4699-4777-92fb-215f326cb7b5 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1551 microversion: 2.1 time: 0.226581 Jun 23 16:02:41.507447 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 125/242] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:41 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1551 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:41.544822 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] validate_networks() for [('1a2e4d24-575a-4d10-8176-da6099ea152d', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:02:42.022838 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:02:42.023259 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:02:42.024462 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:02:42.025347 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:02:42.025856 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:02:42.037084 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:42.037526 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:42.038308 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:42.038841 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:42.057404 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Getting quotas for project ab9c00b7758f45daa7063ee2327c59d0. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:02:42.061522 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Getting quotas for user ad8dac501e254a8d9671083b7b7d413c and project ab9c00b7758f45daa7063ee2327c59d0. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:02:42.073385 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:02:42.075910 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:02:42.128082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d49ff607-32de-4908-9365-69294cd3d583 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686745 Jun 23 16:02:42.128910 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 118/243] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:02:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:02:42.139298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e4df819b-0e77-4a41-9ab8-049e7a50322e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:42.139938 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e4df819b-0e77-4a41-9ab8-049e7a50322e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:42.195049 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e4df819b-0e77-4a41-9ab8-049e7a50322e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:42.202439 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e4df819b-0e77-4a41-9ab8-049e7a50322e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1214 microversion: 2.1 time: 0.067094 Jun 23 16:02:42.203148 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 126/244] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:42 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:42.456426 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3a85c92f-f91d-4a4d-9b50-daafb213adf9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:42.457084 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3a85c92f-f91d-4a4d-9b50-daafb213adf9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:42.463474 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3a85c92f-f91d-4a4d-9b50-daafb213adf9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:42.464002 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3a85c92f-f91d-4a4d-9b50-daafb213adf9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:42.464789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3a85c92f-f91d-4a4d-9b50-daafb213adf9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:42.465224 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3a85c92f-f91d-4a4d-9b50-daafb213adf9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:42.523928 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6836e849-e60a-4cdd-9668-9fce0998fe9d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:42.525517 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6836e849-e60a-4cdd-9668-9fce0998fe9d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:42.533704 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6836e849-e60a-4cdd-9668-9fce0998fe9d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:42.534432 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6836e849-e60a-4cdd-9668-9fce0998fe9d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:42.535347 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6836e849-e60a-4cdd-9668-9fce0998fe9d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:42.536045 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6836e849-e60a-4cdd-9668-9fce0998fe9d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:42.609898 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3a85c92f-f91d-4a4d-9b50-daafb213adf9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:42.619226 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3a85c92f-f91d-4a4d-9b50-daafb213adf9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.166615 Jun 23 16:02:42.619813 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 119/245] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:42 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:42.679539 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6836e849-e60a-4cdd-9668-9fce0998fe9d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:42.688421 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6836e849-e60a-4cdd-9668-9fce0998fe9d tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1551 microversion: 2.1 time: 0.168581 Jun 23 16:02:42.689010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 127/246] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:42 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:43.220443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8e26cfcd-1432-4638-9992-95be3f1301e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:43.221076 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8e26cfcd-1432-4638-9992-95be3f1301e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:43.227952 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e26cfcd-1432-4638-9992-95be3f1301e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:43.228389 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e26cfcd-1432-4638-9992-95be3f1301e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:43.229157 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e26cfcd-1432-4638-9992-95be3f1301e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:43.229581 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8e26cfcd-1432-4638-9992-95be3f1301e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:43.307221 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8e26cfcd-1432-4638-9992-95be3f1301e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:43.315774 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8e26cfcd-1432-4638-9992-95be3f1301e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1218 microversion: 2.1 time: 0.099378 Jun 23 16:02:43.316360 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 120/247] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:43 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:43.643124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ab7a9c1b-a456-4f8a-ba27-1eadbd4e0766 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:43.643737 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ab7a9c1b-a456-4f8a-ba27-1eadbd4e0766 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:43.651642 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ab7a9c1b-a456-4f8a-ba27-1eadbd4e0766 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:43.652356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ab7a9c1b-a456-4f8a-ba27-1eadbd4e0766 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:43.653145 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ab7a9c1b-a456-4f8a-ba27-1eadbd4e0766 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:43.653656 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ab7a9c1b-a456-4f8a-ba27-1eadbd4e0766 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:43.706167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f58915e7-52fe-453d-b949-fd5136db209e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:43.707217 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f58915e7-52fe-453d-b949-fd5136db209e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:43.726247 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f58915e7-52fe-453d-b949-fd5136db209e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:43.727682 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f58915e7-52fe-453d-b949-fd5136db209e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:43.727682 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f58915e7-52fe-453d-b949-fd5136db209e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:43.727940 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f58915e7-52fe-453d-b949-fd5136db209e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:43.814315 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ab7a9c1b-a456-4f8a-ba27-1eadbd4e0766 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:43.822772 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ab7a9c1b-a456-4f8a-ba27-1eadbd4e0766 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.183554 Jun 23 16:02:43.823417 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 128/248] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:43 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:43.923666 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f58915e7-52fe-453d-b949-fd5136db209e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:43.932864 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f58915e7-52fe-453d-b949-fd5136db209e tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1551 microversion: 2.1 time: 0.230943 Jun 23 16:02:43.933483 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 121/249] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:43 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1551 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:44.333004 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f9cf229f-426b-46d2-b310-f257cc7a35aa tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:44.333617 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f9cf229f-426b-46d2-b310-f257cc7a35aa tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:44.340837 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f9cf229f-426b-46d2-b310-f257cc7a35aa tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:44.341273 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f9cf229f-426b-46d2-b310-f257cc7a35aa tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:44.342090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f9cf229f-426b-46d2-b310-f257cc7a35aa tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:44.342531 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f9cf229f-426b-46d2-b310-f257cc7a35aa tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:44.407569 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f9cf229f-426b-46d2-b310-f257cc7a35aa tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:44.416586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f9cf229f-426b-46d2-b310-f257cc7a35aa tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1218 microversion: 2.1 time: 0.087407 Jun 23 16:02:44.417196 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 129/250] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:44 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:44.842426 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a5089d62-a574-4100-81dc-d9647a99f189 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:44.843133 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a5089d62-a574-4100-81dc-d9647a99f189 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:44.852960 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a5089d62-a574-4100-81dc-d9647a99f189 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:44.853666 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a5089d62-a574-4100-81dc-d9647a99f189 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:44.854922 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a5089d62-a574-4100-81dc-d9647a99f189 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:44.855454 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a5089d62-a574-4100-81dc-d9647a99f189 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:44.955116 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-daa594bd-ac57-4933-95e8-0138a8fb8665 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:44.956241 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-daa594bd-ac57-4933-95e8-0138a8fb8665 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:44.968749 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-daa594bd-ac57-4933-95e8-0138a8fb8665 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:44.969545 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-daa594bd-ac57-4933-95e8-0138a8fb8665 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:44.970876 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-daa594bd-ac57-4933-95e8-0138a8fb8665 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:44.971717 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-daa594bd-ac57-4933-95e8-0138a8fb8665 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:45.036542 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a5089d62-a574-4100-81dc-d9647a99f189 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:45.045090 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a5089d62-a574-4100-81dc-d9647a99f189 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.208920 Jun 23 16:02:45.045670 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 122/251] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:44 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:45.158029 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-daa594bd-ac57-4933-95e8-0138a8fb8665 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:45.167831 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-daa594bd-ac57-4933-95e8-0138a8fb8665 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1551 microversion: 2.1 time: 0.220104 Jun 23 16:02:45.168748 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 130/252] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:44 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1551 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:45.439761 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-487757c8-90c7-4ad9-8b28-3aa50411d813 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:45.440402 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-487757c8-90c7-4ad9-8b28-3aa50411d813 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:45.453508 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-487757c8-90c7-4ad9-8b28-3aa50411d813 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:45.454420 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-487757c8-90c7-4ad9-8b28-3aa50411d813 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:45.455380 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-487757c8-90c7-4ad9-8b28-3aa50411d813 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:45.455815 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-487757c8-90c7-4ad9-8b28-3aa50411d813 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:45.476359 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:45.548955 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-487757c8-90c7-4ad9-8b28-3aa50411d813 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:45.557639 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-487757c8-90c7-4ad9-8b28-3aa50411d813 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1218 microversion: 2.1 time: 0.125569 Jun 23 16:02:45.558525 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 123/253] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:45 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:46.068649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e5540e93-908b-4246-b6c1-2027a0858305 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:46.069289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e5540e93-908b-4246-b6c1-2027a0858305 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:46.076700 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e5540e93-908b-4246-b6c1-2027a0858305 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:46.077154 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e5540e93-908b-4246-b6c1-2027a0858305 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:46.077947 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e5540e93-908b-4246-b6c1-2027a0858305 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:46.078482 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e5540e93-908b-4246-b6c1-2027a0858305 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:46.190324 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2910ad9d-4443-4ff1-9faf-745ce1020aa6 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:46.193971 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2910ad9d-4443-4ff1-9faf-745ce1020aa6 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:46.201388 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2910ad9d-4443-4ff1-9faf-745ce1020aa6 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:46.202375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2910ad9d-4443-4ff1-9faf-745ce1020aa6 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:46.203551 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2910ad9d-4443-4ff1-9faf-745ce1020aa6 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:46.204308 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2910ad9d-4443-4ff1-9faf-745ce1020aa6 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:46.243167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e5540e93-908b-4246-b6c1-2027a0858305 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:46.257001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e5540e93-908b-4246-b6c1-2027a0858305 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.193219 Jun 23 16:02:46.263059 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 131/254] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:46 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:46.355778 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2910ad9d-4443-4ff1-9faf-745ce1020aa6 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:46.368943 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2910ad9d-4443-4ff1-9faf-745ce1020aa6 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1551 microversion: 2.1 time: 0.184237 Jun 23 16:02:46.369758 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 124/255] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:46 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1551 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:46.585405 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2e8a4408-7f2b-4268-8755-427a0ded78de tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:46.585777 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2e8a4408-7f2b-4268-8755-427a0ded78de tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:46.588442 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:46.594110 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e8a4408-7f2b-4268-8755-427a0ded78de tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:46.594551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e8a4408-7f2b-4268-8755-427a0ded78de tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:46.595350 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e8a4408-7f2b-4268-8755-427a0ded78de tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:46.595779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e8a4408-7f2b-4268-8755-427a0ded78de tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:46.679769 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2e8a4408-7f2b-4268-8755-427a0ded78de tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:46.691976 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2e8a4408-7f2b-4268-8755-427a0ded78de tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1218 microversion: 2.1 time: 0.110280 Jun 23 16:02:46.692937 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 132/256] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:46 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:47.276087 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fa9f05db-54bf-4f1a-b6b2-24b6d4f5b003 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:47.276639 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fa9f05db-54bf-4f1a-b6b2-24b6d4f5b003 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:47.283005 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fa9f05db-54bf-4f1a-b6b2-24b6d4f5b003 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:47.283445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fa9f05db-54bf-4f1a-b6b2-24b6d4f5b003 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:47.284214 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fa9f05db-54bf-4f1a-b6b2-24b6d4f5b003 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:47.284628 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fa9f05db-54bf-4f1a-b6b2-24b6d4f5b003 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:47.387295 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f6aa36ee-b92d-45fa-83a1-26cac9be9c66 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:47.388288 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f6aa36ee-b92d-45fa-83a1-26cac9be9c66 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:47.397156 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6aa36ee-b92d-45fa-83a1-26cac9be9c66 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:47.398295 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6aa36ee-b92d-45fa-83a1-26cac9be9c66 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:47.399436 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6aa36ee-b92d-45fa-83a1-26cac9be9c66 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:47.400416 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6aa36ee-b92d-45fa-83a1-26cac9be9c66 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:47.445184 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fa9f05db-54bf-4f1a-b6b2-24b6d4f5b003 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:47.453572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fa9f05db-54bf-4f1a-b6b2-24b6d4f5b003 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.181694 Jun 23 16:02:47.454175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 125/257] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:47 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:47.571764 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f6aa36ee-b92d-45fa-83a1-26cac9be9c66 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:47.585352 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f6aa36ee-b92d-45fa-83a1-26cac9be9c66 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1551 microversion: 2.1 time: 0.203041 Jun 23 16:02:47.585928 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 133/258] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:47 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1551 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:47.717768 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-64a7d7a9-ad18-43c5-857c-ad650b0c6dad tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:47.718386 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-64a7d7a9-ad18-43c5-857c-ad650b0c6dad tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:47.725066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64a7d7a9-ad18-43c5-857c-ad650b0c6dad tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:47.725529 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64a7d7a9-ad18-43c5-857c-ad650b0c6dad tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:47.726366 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64a7d7a9-ad18-43c5-857c-ad650b0c6dad tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:47.727505 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-64a7d7a9-ad18-43c5-857c-ad650b0c6dad tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:47.798717 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-64a7d7a9-ad18-43c5-857c-ad650b0c6dad tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:47.806807 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-64a7d7a9-ad18-43c5-857c-ad650b0c6dad tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1218 microversion: 2.1 time: 0.092956 Jun 23 16:02:47.807399 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 126/259] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:47 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:48.478068 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-80cbf816-0d01-40ae-a2f3-470e0dbf29d7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:48.480030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-80cbf816-0d01-40ae-a2f3-470e0dbf29d7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:48.486175 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-80cbf816-0d01-40ae-a2f3-470e0dbf29d7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:48.486618 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-80cbf816-0d01-40ae-a2f3-470e0dbf29d7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:48.487452 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-80cbf816-0d01-40ae-a2f3-470e0dbf29d7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:48.488054 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-80cbf816-0d01-40ae-a2f3-470e0dbf29d7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:48.603075 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9d7fe5c0-0b4a-46eb-8e90-826df9ccaaec tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:48.603683 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9d7fe5c0-0b4a-46eb-8e90-826df9ccaaec tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:48.610473 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d7fe5c0-0b4a-46eb-8e90-826df9ccaaec tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:48.610944 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d7fe5c0-0b4a-46eb-8e90-826df9ccaaec tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:48.611702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d7fe5c0-0b4a-46eb-8e90-826df9ccaaec tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:48.612128 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d7fe5c0-0b4a-46eb-8e90-826df9ccaaec tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:48.722833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-80cbf816-0d01-40ae-a2f3-470e0dbf29d7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:48.731961 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-80cbf816-0d01-40ae-a2f3-470e0dbf29d7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.257793 Jun 23 16:02:48.733066 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 134/260] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:48 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:48.747902 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9d7fe5c0-0b4a-46eb-8e90-826df9ccaaec tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:48.755895 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9d7fe5c0-0b4a-46eb-8e90-826df9ccaaec tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1551 microversion: 2.1 time: 0.156634 Jun 23 16:02:48.756470 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 127/261] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:48 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:48.824437 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-df465e41-9b71-465d-8b76-38e7e6593ebb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:48.825364 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-df465e41-9b71-465d-8b76-38e7e6593ebb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:48.837595 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-df465e41-9b71-465d-8b76-38e7e6593ebb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:48.838130 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-df465e41-9b71-465d-8b76-38e7e6593ebb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:48.839010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-df465e41-9b71-465d-8b76-38e7e6593ebb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:48.842439 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-df465e41-9b71-465d-8b76-38e7e6593ebb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:48.995758 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-df465e41-9b71-465d-8b76-38e7e6593ebb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:49.011886 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-df465e41-9b71-465d-8b76-38e7e6593ebb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1266 microversion: 2.1 time: 0.191589 Jun 23 16:02:49.015512 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 135/262] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:48 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:49.073255 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-2db5d2c7-057e-4527-bbcf-4a7853291af3 req-552b7542-c074-41e4-99b6-354e530edb20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff2e14e-d713-4245-be6a-3055e546bd1d", "name": "network-vif-deleted", "tag": "4432f611-e405-4a38-b98a-2d230d1bbc40"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:02:49.081969 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2db5d2c7-057e-4527-bbcf-4a7853291af3 req-552b7542-c074-41e4-99b6-354e530edb20 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:49.082655 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2db5d2c7-057e-4527-bbcf-4a7853291af3 req-552b7542-c074-41e4-99b6-354e530edb20 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:49.096469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-2db5d2c7-057e-4527-bbcf-4a7853291af3 req-552b7542-c074-41e4-99b6-354e530edb20 service nova] Creating event network-vif-deleted:4432f611-e405-4a38-b98a-2d230d1bbc40 for instance 0ff2e14e-d713-4245-be6a-3055e546bd1d on hv-cinder-83538 Jun 23 16:02:49.103031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-2db5d2c7-057e-4527-bbcf-4a7853291af3 req-552b7542-c074-41e4-99b6-354e530edb20 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033397 Jun 23 16:02:49.106842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 128/263] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:02:49.759257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0534b9d0-ccdd-451f-bb5d-8b110463c566 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:49.759799 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0534b9d0-ccdd-451f-bb5d-8b110463c566 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:49.769633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0534b9d0-ccdd-451f-bb5d-8b110463c566 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:49.770080 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0534b9d0-ccdd-451f-bb5d-8b110463c566 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:49.773463 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0534b9d0-ccdd-451f-bb5d-8b110463c566 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:49.774798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0534b9d0-ccdd-451f-bb5d-8b110463c566 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:49.778837 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b832ab03-99d9-497d-8947-6e1b90bf98fe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:49.779789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b832ab03-99d9-497d-8947-6e1b90bf98fe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:49.783853 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:49.794891 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b832ab03-99d9-497d-8947-6e1b90bf98fe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:49.796642 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b832ab03-99d9-497d-8947-6e1b90bf98fe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:49.797798 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b832ab03-99d9-497d-8947-6e1b90bf98fe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:49.798639 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b832ab03-99d9-497d-8947-6e1b90bf98fe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:49.897806 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b832ab03-99d9-497d-8947-6e1b90bf98fe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:49.911790 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b832ab03-99d9-497d-8947-6e1b90bf98fe tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1343 microversion: 2.1 time: 0.140013 Jun 23 16:02:49.913080 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 129/264] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:49 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1343 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:50.031226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0534b9d0-ccdd-451f-bb5d-8b110463c566 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:50.033552 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f47c0294-c30f-4188-9f49-bd53ed1793ce tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:50.034233 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f47c0294-c30f-4188-9f49-bd53ed1793ce tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:50.040403 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0534b9d0-ccdd-451f-bb5d-8b110463c566 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.293803 Jun 23 16:02:50.041079 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f47c0294-c30f-4188-9f49-bd53ed1793ce tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:50.041517 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f47c0294-c30f-4188-9f49-bd53ed1793ce tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:50.042278 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f47c0294-c30f-4188-9f49-bd53ed1793ce tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:50.042719 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f47c0294-c30f-4188-9f49-bd53ed1793ce tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:50.050251 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 136/265] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:49 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:50.185156 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f47c0294-c30f-4188-9f49-bd53ed1793ce tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:50.193800 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f47c0294-c30f-4188-9f49-bd53ed1793ce tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1314 microversion: 2.1 time: 0.164426 Jun 23 16:02:50.194374 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 130/266] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:50 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:50.931762 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:50.932416 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:50.939114 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:50.939747 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:50.942060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:50.942587 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:51.000149 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:51.000726 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:51.001291 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lazy-loading 'fault' on Instance uuid 0ff2e14e-d713-4245-be6a-3055e546bd1d {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:02:51.060358 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-00dc9be4-410e-4654-b15f-8c26cadf6d16 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:51.060982 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-00dc9be4-410e-4654-b15f-8c26cadf6d16 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:51.071709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-00dc9be4-410e-4654-b15f-8c26cadf6d16 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:51.072433 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-00dc9be4-410e-4654-b15f-8c26cadf6d16 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:51.073375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-00dc9be4-410e-4654-b15f-8c26cadf6d16 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:51.078734 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-00dc9be4-410e-4654-b15f-8c26cadf6d16 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:51.087225 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82e02e90305a424c8e719a92bd084a5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27aed572a9da43ca919d77bd579224a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:51.098821 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-307c3f5f-5ef5-4f82-b4b6-f9d06c39cdd1 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 200 len: 1302 microversion: 2.1 time: 0.172126 Jun 23 16:02:51.099584 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 137/267] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:50 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 1302 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:51.107990 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-64268b4c-e3b3-496d-832e-446e22f6aad4 req-d4273298-7be4-4a0d-b952-9e291b3a2c04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f8140b-9b15-4515-b3d5-feab25cb5f6b", "tag": "f0f3facc-f04e-40f2-b6aa-01d0da39308f"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:02:51.127506 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-64268b4c-e3b3-496d-832e-446e22f6aad4 req-d4273298-7be4-4a0d-b952-9e291b3a2c04 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:51.128623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-64268b4c-e3b3-496d-832e-446e22f6aad4 req-d4273298-7be4-4a0d-b952-9e291b3a2c04 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:51.144161 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-64268b4c-e3b3-496d-832e-446e22f6aad4 req-d4273298-7be4-4a0d-b952-9e291b3a2c04 service nova] Creating event network-changed:f0f3facc-f04e-40f2-b6aa-01d0da39308f for instance 17f8140b-9b15-4515-b3d5-feab25cb5f6b on hv-cinder-83538 Jun 23 16:02:51.151658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-64268b4c-e3b3-496d-832e-446e22f6aad4 req-d4273298-7be4-4a0d-b952-9e291b3a2c04 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050598 Jun 23 16:02:51.152659 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 138/268] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:02:51.212384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ec4ecea2-9581-4994-bc56-5a766528302f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:51.213236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ec4ecea2-9581-4994-bc56-5a766528302f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:51.220547 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec4ecea2-9581-4994-bc56-5a766528302f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:51.220985 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec4ecea2-9581-4994-bc56-5a766528302f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:51.221765 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec4ecea2-9581-4994-bc56-5a766528302f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:51.222375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec4ecea2-9581-4994-bc56-5a766528302f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:51.249056 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-00dc9be4-410e-4654-b15f-8c26cadf6d16 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:51.258819 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-00dc9be4-410e-4654-b15f-8c26cadf6d16 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.203745 Jun 23 16:02:51.259656 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 131/269] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:51 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:51.391911 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ec4ecea2-9581-4994-bc56-5a766528302f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:51.401699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ec4ecea2-9581-4994-bc56-5a766528302f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1314 microversion: 2.1 time: 0.193947 Jun 23 16:02:51.402432 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 139/270] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:51 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:52.116518 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5893bafd-829a-46de-8035-d95111f661cc tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:52.117132 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5893bafd-829a-46de-8035-d95111f661cc tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:52.120764 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:52.121402 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:52.132166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5893bafd-829a-46de-8035-d95111f661cc tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:52.134504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5893bafd-829a-46de-8035-d95111f661cc tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:52.135349 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5893bafd-829a-46de-8035-d95111f661cc tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:52.136470 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5893bafd-829a-46de-8035-d95111f661cc tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:52.164959 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-5893bafd-829a-46de-8035-d95111f661cc tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] HTTP exception thrown: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5893bafd-829a-46de-8035-d95111f661cc tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Request method failure captured: Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d HTTP/1.1 Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4zC34WAxSVx5Zb2qoxBWb2hu8Sr8ggKwOLaOlRrXurgtlSNrQuXGYQRaObCT4CDMhaZ6RbbhgsH5mwCqKpbxJfSDA17hTtTa3Qzze4pe3Q7YSYXYaJFOAl4jVybDvyIVJLfpd7KUVtzQ-48uodU0ubfbb_h1n67cnIWpHPpg64WhM Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 27aed572a9da43ca919d77bd579224a9 Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:02:52.170935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_27aed572a9da43ca919d77bd579224a9"}]}] Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 27aed572a9da43ca919d77bd579224a9 Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-DeleteServersTestJSON-893882658-project Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: 82e02e90305a424c8e719a92bd084a5f Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-DeleteServersTestJSON-893882658-project Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:52.172445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '0ff2e14e-d713-4245-be6a-3055e546bd1d'} Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:02:52.173223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:52.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:52.182485 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5893bafd-829a-46de-8035-d95111f661cc tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Returning 404 to user: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:02:52.183544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5893bafd-829a-46de-8035-d95111f661cc tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 404 len: 111 microversion: 2.1 time: 0.071377 Jun 23 16:02:52.184807 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 132/271] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:52 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:02:52.277507 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c7a8f55a-a566-435f-94e2-20d111c1138b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:52.278263 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c7a8f55a-a566-435f-94e2-20d111c1138b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:52.281119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:52.287684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7a8f55a-a566-435f-94e2-20d111c1138b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:52.288267 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7a8f55a-a566-435f-94e2-20d111c1138b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:52.289333 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7a8f55a-a566-435f-94e2-20d111c1138b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:52.290063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7a8f55a-a566-435f-94e2-20d111c1138b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:52.344854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0278af59-1dc5-482c-9f40-2371a6e8e886 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:52.348499 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0278af59-1dc5-482c-9f40-2371a6e8e886 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:52.362947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0278af59-1dc5-482c-9f40-2371a6e8e886 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:52.362947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0278af59-1dc5-482c-9f40-2371a6e8e886 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:52.363157 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0278af59-1dc5-482c-9f40-2371a6e8e886 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:52.363750 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0278af59-1dc5-482c-9f40-2371a6e8e886 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:52.383846 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-0278af59-1dc5-482c-9f40-2371a6e8e886 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] HTTP exception thrown: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0278af59-1dc5-482c-9f40-2371a6e8e886 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Request method failure captured: Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d/os-volume_attachments HTTP/1.1 Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4zC34WAxSVx5Zb2qoxBWb2hu8Sr8ggKwOLaOlRrXurgtlSNrQuXGYQRaObCT4CDMhaZ6RbbhgsH5mwCqKpbxJfSDA17hTtTa3Qzze4pe3Q7YSYXYaJFOAl4jVybDvyIVJLfpd7KUVtzQ-48uodU0ubfbb_h1n67cnIWpHPpg64WhM Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 27aed572a9da43ca919d77bd579224a9 Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:02:52.386201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_27aed572a9da43ca919d77bd579224a9"}]}] Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 27aed572a9da43ca919d77bd579224a9 Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-DeleteServersTestJSON-893882658-project Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: 82e02e90305a424c8e719a92bd084a5f Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-DeleteServersTestJSON-893882658-project Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:52.387684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'server_id': '0ff2e14e-d713-4245-be6a-3055e546bd1d'} Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:02:52.388401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:52.389556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:52.392531 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0278af59-1dc5-482c-9f40-2371a6e8e886 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Returning 404 to user: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:02:52.393787 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0278af59-1dc5-482c-9f40-2371a6e8e886 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059306 Jun 23 16:02:52.394812 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 133/272] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:02:52 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d/os-volume_attachments => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:02:52.426109 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-06031228-8c3f-4167-9c51-d01a3f9c6915 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:52.426833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-06031228-8c3f-4167-9c51-d01a3f9c6915 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:52.436638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-06031228-8c3f-4167-9c51-d01a3f9c6915 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:52.437236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-06031228-8c3f-4167-9c51-d01a3f9c6915 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:52.438470 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-06031228-8c3f-4167-9c51-d01a3f9c6915 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:52.439169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-06031228-8c3f-4167-9c51-d01a3f9c6915 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:52.565303 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c7a8f55a-a566-435f-94e2-20d111c1138b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:52.575961 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c7a8f55a-a566-435f-94e2-20d111c1138b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.303371 Jun 23 16:02:52.576809 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 140/273] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:52 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:52.666108 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-06031228-8c3f-4167-9c51-d01a3f9c6915 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:52.674127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-06031228-8c3f-4167-9c51-d01a3f9c6915 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1314 microversion: 2.1 time: 0.255859 Jun 23 16:02:52.674752 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 134/274] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:52 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:53.593382 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5342b979-bfb2-4c93-bab4-ba1768dac278 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:53.593989 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5342b979-bfb2-4c93-bab4-ba1768dac278 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:53.602329 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5342b979-bfb2-4c93-bab4-ba1768dac278 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:53.602724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5342b979-bfb2-4c93-bab4-ba1768dac278 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:53.603518 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5342b979-bfb2-4c93-bab4-ba1768dac278 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:53.604766 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5342b979-bfb2-4c93-bab4-ba1768dac278 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:53.671886 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-16060e63-21d4-4d71-bd97-36e52f0013a7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:53.672383 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-16060e63-21d4-4d71-bd97-36e52f0013a7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:53.680993 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16060e63-21d4-4d71-bd97-36e52f0013a7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:53.681290 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16060e63-21d4-4d71-bd97-36e52f0013a7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:53.682061 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16060e63-21d4-4d71-bd97-36e52f0013a7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:53.682979 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16060e63-21d4-4d71-bd97-36e52f0013a7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:53.704833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-16060e63-21d4-4d71-bd97-36e52f0013a7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] HTTP exception thrown: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-16060e63-21d4-4d71-bd97-36e52f0013a7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Request method failure captured: Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d HTTP/1.1 Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4zC34WAxSVx5Zb2qoxBWb2hu8Sr8ggKwOLaOlRrXurgtlSNrQuXGYQRaObCT4CDMhaZ6RbbhgsH5mwCqKpbxJfSDA17hTtTa3Qzze4pe3Q7YSYXYaJFOAl4jVybDvyIVJLfpd7KUVtzQ-48uodU0ubfbb_h1n67cnIWpHPpg64WhM Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 27aed572a9da43ca919d77bd579224a9 Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:02:53.706441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_27aed572a9da43ca919d77bd579224a9"}]}] Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 27aed572a9da43ca919d77bd579224a9 Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-DeleteServersTestJSON-893882658-project Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: 82e02e90305a424c8e719a92bd084a5f Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-DeleteServersTestJSON-893882658-project Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:53.707854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '0ff2e14e-d713-4245-be6a-3055e546bd1d'} Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:02:53.708636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:53.710342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:02:53.711646 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-16060e63-21d4-4d71-bd97-36e52f0013a7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Returning 404 to user: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:02:53.711646 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-16060e63-21d4-4d71-bd97-36e52f0013a7 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 404 len: 111 microversion: 2.1 time: 0.040697 Jun 23 16:02:53.713656 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 135/275] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:02:53 2022] DELETE /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:02:53.721052 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-574b7573-eccd-4c41-ae4e-ac3c7b51279d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:53.721737 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-574b7573-eccd-4c41-ae4e-ac3c7b51279d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:53.730416 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-574b7573-eccd-4c41-ae4e-ac3c7b51279d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:53.731227 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-574b7573-eccd-4c41-ae4e-ac3c7b51279d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:53.732169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-574b7573-eccd-4c41-ae4e-ac3c7b51279d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:53.732761 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-574b7573-eccd-4c41-ae4e-ac3c7b51279d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:53.778119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5342b979-bfb2-4c93-bab4-ba1768dac278 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:53.787180 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5342b979-bfb2-4c93-bab4-ba1768dac278 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.197319 Jun 23 16:02:53.797071 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 141/276] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:53 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:53.803872 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-36e183a2-c85a-4889-bc79-da0898e9c387 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:53.805684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-36e183a2-c85a-4889-bc79-da0898e9c387 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] [instance: 0ff2e14e-d713-4245-be6a-3055e546bd1d] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:53.812674 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-36e183a2-c85a-4889-bc79-da0898e9c387 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:53.813741 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-36e183a2-c85a-4889-bc79-da0898e9c387 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:53.815658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-36e183a2-c85a-4889-bc79-da0898e9c387 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:53.816421 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-36e183a2-c85a-4889-bc79-da0898e9c387 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:53.836215 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-36e183a2-c85a-4889-bc79-da0898e9c387 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] HTTP exception thrown: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-36e183a2-c85a-4889-bc79-da0898e9c387 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Request method failure captured: Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d HTTP/1.1 Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4zC34WAxSVx5Zb2qoxBWb2hu8Sr8ggKwOLaOlRrXurgtlSNrQuXGYQRaObCT4CDMhaZ6RbbhgsH5mwCqKpbxJfSDA17hTtTa3Qzze4pe3Q7YSYXYaJFOAl4jVybDvyIVJLfpd7KUVtzQ-48uodU0ubfbb_h1n67cnIWpHPpg64WhM Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 27aed572a9da43ca919d77bd579224a9 Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:02:53.842086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/27aed572a9da43ca919d77bd579224a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_27aed572a9da43ca919d77bd579224a9"}]}] Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 27aed572a9da43ca919d77bd579224a9 Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-DeleteServersTestJSON-893882658 Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-DeleteServersTestJSON-893882658-project Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: 82e02e90305a424c8e719a92bd084a5f Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-DeleteServersTestJSON-893882658-project Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:53.843558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '0ff2e14e-d713-4245-be6a-3055e546bd1d'} Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:02:53.844211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. Jun 23 16:02:53.845257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:02:53.848113 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-36e183a2-c85a-4889-bc79-da0898e9c387 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] Returning 404 to user: Instance 0ff2e14e-d713-4245-be6a-3055e546bd1d could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:02:53.849358 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-36e183a2-c85a-4889-bc79-da0898e9c387 tempest-DeleteServersTestJSON-893882658 tempest-DeleteServersTestJSON-893882658-project] 10.222.0.46 "GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d" status: 404 len: 111 microversion: 2.1 time: 0.050736 Jun 23 16:02:53.850078 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 142/277] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:53 2022] GET /compute/v2.1/servers/0ff2e14e-d713-4245-be6a-3055e546bd1d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:02:54.100204 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-574b7573-eccd-4c41-ae4e-ac3c7b51279d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:54.109080 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-574b7573-eccd-4c41-ae4e-ac3c7b51279d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1314 microversion: 2.1 time: 0.394045 Jun 23 16:02:54.110075 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 136/278] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:53 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:54.807901 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-145bee80-9f7f-48d7-86ae-fd753c7251fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:54.808867 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-145bee80-9f7f-48d7-86ae-fd753c7251fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:54.822538 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-145bee80-9f7f-48d7-86ae-fd753c7251fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:54.823459 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-145bee80-9f7f-48d7-86ae-fd753c7251fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:54.824654 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-145bee80-9f7f-48d7-86ae-fd753c7251fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:54.825831 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-145bee80-9f7f-48d7-86ae-fd753c7251fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:55.041627 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-145bee80-9f7f-48d7-86ae-fd753c7251fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:55.048544 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:02:55.052093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-145bee80-9f7f-48d7-86ae-fd753c7251fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.250391 Jun 23 16:02:55.062917 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 143/279] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:54 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:55.127287 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-23627664-6038-43b3-b7d0-095a3e1b4fba tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:55.127906 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-23627664-6038-43b3-b7d0-095a3e1b4fba tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:55.138659 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23627664-6038-43b3-b7d0-095a3e1b4fba tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:55.139136 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23627664-6038-43b3-b7d0-095a3e1b4fba tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:55.140358 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23627664-6038-43b3-b7d0-095a3e1b4fba tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:55.140912 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-23627664-6038-43b3-b7d0-095a3e1b4fba tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:55.660822 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-23627664-6038-43b3-b7d0-095a3e1b4fba tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:55.673651 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-23627664-6038-43b3-b7d0-095a3e1b4fba tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1314 microversion: 2.1 time: 0.549623 Jun 23 16:02:55.675022 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 137/280] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:55 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:56.071429 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5b63038a-2561-4733-acb8-54112df960de tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:56.073367 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5b63038a-2561-4733-acb8-54112df960de tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:56.085663 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b63038a-2561-4733-acb8-54112df960de tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:56.087340 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b63038a-2561-4733-acb8-54112df960de tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:56.088243 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b63038a-2561-4733-acb8-54112df960de tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:56.088678 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b63038a-2561-4733-acb8-54112df960de tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:56.301862 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5b63038a-2561-4733-acb8-54112df960de tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:56.312202 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5b63038a-2561-4733-acb8-54112df960de tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.244318 Jun 23 16:02:56.313054 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 144/281] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:56 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:56.693260 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5e38a619-4c7c-4747-8178-5aa2d9d63a86 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:56.693884 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5e38a619-4c7c-4747-8178-5aa2d9d63a86 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:56.704928 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e38a619-4c7c-4747-8178-5aa2d9d63a86 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:56.714843 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e38a619-4c7c-4747-8178-5aa2d9d63a86 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:56.714843 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e38a619-4c7c-4747-8178-5aa2d9d63a86 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:56.714843 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e38a619-4c7c-4747-8178-5aa2d9d63a86 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:57.119999 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5e38a619-4c7c-4747-8178-5aa2d9d63a86 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:57.131436 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5e38a619-4c7c-4747-8178-5aa2d9d63a86 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1314 microversion: 2.1 time: 0.442913 Jun 23 16:02:57.144539 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 138/282] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:56 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:02:57.329348 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9fc76576-13df-44e8-be5e-e886eb1a41ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:57.330852 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9fc76576-13df-44e8-be5e-e886eb1a41ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:57.344240 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9fc76576-13df-44e8-be5e-e886eb1a41ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:57.345030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9fc76576-13df-44e8-be5e-e886eb1a41ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:57.346076 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9fc76576-13df-44e8-be5e-e886eb1a41ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:57.346748 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9fc76576-13df-44e8-be5e-e886eb1a41ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:57.693644 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9fc76576-13df-44e8-be5e-e886eb1a41ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:57.707705 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9fc76576-13df-44e8-be5e-e886eb1a41ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.382110 Jun 23 16:02:57.708897 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 145/283] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:57 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:58.156617 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2d071384-f0af-46d8-a7a0-28b832eb11d2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:58.157974 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2d071384-f0af-46d8-a7a0-28b832eb11d2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:58.177851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2d071384-f0af-46d8-a7a0-28b832eb11d2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:58.181119 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2d071384-f0af-46d8-a7a0-28b832eb11d2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:58.188721 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2d071384-f0af-46d8-a7a0-28b832eb11d2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:58.189457 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2d071384-f0af-46d8-a7a0-28b832eb11d2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:58.529723 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2d071384-f0af-46d8-a7a0-28b832eb11d2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:58.545455 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2d071384-f0af-46d8-a7a0-28b832eb11d2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1314 microversion: 2.1 time: 0.398476 Jun 23 16:02:58.546067 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 139/284] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:58 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:58.727739 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3386941f-81cb-40fc-93fd-ddd263d40459 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:58.729163 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3386941f-81cb-40fc-93fd-ddd263d40459 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:58.739766 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3386941f-81cb-40fc-93fd-ddd263d40459 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:58.740793 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3386941f-81cb-40fc-93fd-ddd263d40459 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:58.744366 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3386941f-81cb-40fc-93fd-ddd263d40459 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:58.746250 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3386941f-81cb-40fc-93fd-ddd263d40459 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:59.131173 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3386941f-81cb-40fc-93fd-ddd263d40459 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:02:59.170927 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3386941f-81cb-40fc-93fd-ddd263d40459 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1521 microversion: 2.1 time: 0.445194 Jun 23 16:02:59.173188 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 146/285] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:58 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:02:59.566145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c0652b5b-85fe-4062-8161-f1050f3b335f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:02:59.567595 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c0652b5b-85fe-4062-8161-f1050f3b335f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:02:59.600164 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c0652b5b-85fe-4062-8161-f1050f3b335f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:59.600635 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c0652b5b-85fe-4062-8161-f1050f3b335f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:02:59.601407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c0652b5b-85fe-4062-8161-f1050f3b335f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:02:59.601880 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c0652b5b-85fe-4062-8161-f1050f3b335f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:00.155604 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c0652b5b-85fe-4062-8161-f1050f3b335f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:00.174364 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c0652b5b-85fe-4062-8161-f1050f3b335f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1314 microversion: 2.1 time: 0.611463 Jun 23 16:03:00.189792 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6890732f-7f17-4f61-aabf-62af7f10a13b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:00.191106 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6890732f-7f17-4f61-aabf-62af7f10a13b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:00.195059 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 140/286] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:02:59 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1314 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:00.210176 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6890732f-7f17-4f61-aabf-62af7f10a13b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:00.210854 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6890732f-7f17-4f61-aabf-62af7f10a13b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:00.212740 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6890732f-7f17-4f61-aabf-62af7f10a13b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:00.214471 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6890732f-7f17-4f61-aabf-62af7f10a13b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:00.447154 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-a33e5545-2140-4543-9587-edc2f40ab474 req-23a45de8-972d-4d54-9a5f-d72c9f41d9dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f8140b-9b15-4515-b3d5-feab25cb5f6b", "name": "network-vif-plugged", "status": "completed", "tag": "f0f3facc-f04e-40f2-b6aa-01d0da39308f"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:00.458321 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-a33e5545-2140-4543-9587-edc2f40ab474 req-23a45de8-972d-4d54-9a5f-d72c9f41d9dc service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:00.463979 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-a33e5545-2140-4543-9587-edc2f40ab474 req-23a45de8-972d-4d54-9a5f-d72c9f41d9dc service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:00.497239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6890732f-7f17-4f61-aabf-62af7f10a13b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:00.500759 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-a33e5545-2140-4543-9587-edc2f40ab474 req-23a45de8-972d-4d54-9a5f-d72c9f41d9dc service nova] Creating event network-vif-plugged:f0f3facc-f04e-40f2-b6aa-01d0da39308f for instance 17f8140b-9b15-4515-b3d5-feab25cb5f6b on hv-cinder-83538 Jun 23 16:03:00.509657 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6890732f-7f17-4f61-aabf-62af7f10a13b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1501 microversion: 2.1 time: 0.323783 Jun 23 16:03:00.512977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 147/287] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:00 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1501 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:00.513452 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-a33e5545-2140-4543-9587-edc2f40ab474 req-23a45de8-972d-4d54-9a5f-d72c9f41d9dc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069714 Jun 23 16:03:00.515678 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 141/288] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:03:00.544955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f46960b2-eeef-4bcf-a067-0768b29f87e3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:00.545581 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f46960b2-eeef-4bcf-a067-0768b29f87e3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:00.596403 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f46960b2-eeef-4bcf-a067-0768b29f87e3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:00.596909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f46960b2-eeef-4bcf-a067-0768b29f87e3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:00.597743 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f46960b2-eeef-4bcf-a067-0768b29f87e3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:00.598284 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f46960b2-eeef-4bcf-a067-0768b29f87e3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:01.174801 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f46960b2-eeef-4bcf-a067-0768b29f87e3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:01.201571 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c60348ac-c130-4a1f-8c7c-b8a7f5f01ad4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:01.203196 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c60348ac-c130-4a1f-8c7c-b8a7f5f01ad4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:01.207864 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f46960b2-eeef-4bcf-a067-0768b29f87e3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1516 microversion: 2.1 time: 0.661002 Jun 23 16:03:01.211708 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 148/289] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:00 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1516 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:01.214020 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c60348ac-c130-4a1f-8c7c-b8a7f5f01ad4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:01.214921 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c60348ac-c130-4a1f-8c7c-b8a7f5f01ad4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:01.216010 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c60348ac-c130-4a1f-8c7c-b8a7f5f01ad4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:01.216659 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c60348ac-c130-4a1f-8c7c-b8a7f5f01ad4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:01.543613 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c60348ac-c130-4a1f-8c7c-b8a7f5f01ad4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:01.559561 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c60348ac-c130-4a1f-8c7c-b8a7f5f01ad4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1314 microversion: 2.1 time: 0.367330 Jun 23 16:03:01.561492 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 142/290] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:01 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:02.581378 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-da074230-7c7f-477b-972c-4a96106e549f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:02.587010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-da074230-7c7f-477b-972c-4a96106e549f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:02.594751 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-da074230-7c7f-477b-972c-4a96106e549f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:02.595387 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-da074230-7c7f-477b-972c-4a96106e549f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:02.596420 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-da074230-7c7f-477b-972c-4a96106e549f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:02.597007 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-da074230-7c7f-477b-972c-4a96106e549f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:02.893909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-da074230-7c7f-477b-972c-4a96106e549f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:02.902740 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-da074230-7c7f-477b-972c-4a96106e549f tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1314 microversion: 2.1 time: 0.324965 Jun 23 16:03:02.903618 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 149/291] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:02 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:02.990260 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-88a004dc-7ab9-421b-babe-72b1c3730f95 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:02.991925 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-88a004dc-7ab9-421b-babe-72b1c3730f95 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:03.001301 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88a004dc-7ab9-421b-babe-72b1c3730f95 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:03.002079 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88a004dc-7ab9-421b-babe-72b1c3730f95 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:03.003666 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88a004dc-7ab9-421b-babe-72b1c3730f95 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:03.004306 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-88a004dc-7ab9-421b-babe-72b1c3730f95 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:03.029389 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:03.040413 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-88a004dc-7ab9-421b-babe-72b1c3730f95 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lazy-loading 'flavor' on Instance uuid 030dcf0e-dfb9-4e58-a617-f6330ae03134 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:03:03.224780 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-88a004dc-7ab9-421b-babe-72b1c3730f95 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134/action" status: 200 len: 32 microversion: 2.1 time: 0.239786 Jun 23 16:03:03.225458 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 143/292] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:03:02 2022] POST /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134/action => generated 32 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 16:03:03.237645 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f3702cc9-602b-46c2-bd90-3d110fd15faf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:03.239500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f3702cc9-602b-46c2-bd90-3d110fd15faf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:03.255755 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3702cc9-602b-46c2-bd90-3d110fd15faf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:03.257004 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3702cc9-602b-46c2-bd90-3d110fd15faf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:03.260874 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3702cc9-602b-46c2-bd90-3d110fd15faf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:03.262136 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3702cc9-602b-46c2-bd90-3d110fd15faf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:03.685143 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f3702cc9-602b-46c2-bd90-3d110fd15faf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:03.707644 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f3702cc9-602b-46c2-bd90-3d110fd15faf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.475056 Jun 23 16:03:03.709555 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 150/293] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:03 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:03.943804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5e5bd442-1ce6-4c38-99b6-40c9a45bfead tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:03.944514 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5e5bd442-1ce6-4c38-99b6-40c9a45bfead tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:03.952991 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e5bd442-1ce6-4c38-99b6-40c9a45bfead tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:03.953425 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e5bd442-1ce6-4c38-99b6-40c9a45bfead tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:03.954208 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e5bd442-1ce6-4c38-99b6-40c9a45bfead tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:03.954637 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5e5bd442-1ce6-4c38-99b6-40c9a45bfead tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:04.165456 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5e5bd442-1ce6-4c38-99b6-40c9a45bfead tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:04.173671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5e5bd442-1ce6-4c38-99b6-40c9a45bfead tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1499 microversion: 2.1 time: 0.241758 Jun 23 16:03:04.174245 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 144/294] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:03 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1499 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:04.736695 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e1979b2f-c145-4cd2-9b17-080fb890a10f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:04.738810 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e1979b2f-c145-4cd2-9b17-080fb890a10f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:04.767668 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1979b2f-c145-4cd2-9b17-080fb890a10f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:04.768159 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1979b2f-c145-4cd2-9b17-080fb890a10f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:04.769945 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1979b2f-c145-4cd2-9b17-080fb890a10f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:04.773256 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1979b2f-c145-4cd2-9b17-080fb890a10f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:04.864047 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-aeed3ca1-eb31-4202-a2b9-544c34950ecb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:04.868172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-aeed3ca1-eb31-4202-a2b9-544c34950ecb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:04.895389 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aeed3ca1-eb31-4202-a2b9-544c34950ecb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:04.903418 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aeed3ca1-eb31-4202-a2b9-544c34950ecb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:04.904621 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aeed3ca1-eb31-4202-a2b9-544c34950ecb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:04.905202 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aeed3ca1-eb31-4202-a2b9-544c34950ecb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:04.979762 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-aeed3ca1-eb31-4202-a2b9-544c34950ecb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:03:05.161795 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e1979b2f-c145-4cd2-9b17-080fb890a10f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:05.171434 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e1979b2f-c145-4cd2-9b17-080fb890a10f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.447500 Jun 23 16:03:05.172304 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 151/295] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:04 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:05.255616 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-aeed3ca1-eb31-4202-a2b9-544c34950ecb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "DELETE /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 204 len: 0 microversion: 2.1 time: 0.394632 Jun 23 16:03:05.257321 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 145/296] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:03:04 2022] DELETE /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:03:05.268943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-659164f7-6b7c-4abb-9424-d137796216e4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:05.269925 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-659164f7-6b7c-4abb-9424-d137796216e4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:05.279637 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-659164f7-6b7c-4abb-9424-d137796216e4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:05.281264 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-659164f7-6b7c-4abb-9424-d137796216e4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:05.282806 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-659164f7-6b7c-4abb-9424-d137796216e4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:05.284363 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-659164f7-6b7c-4abb-9424-d137796216e4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:05.688610 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-659164f7-6b7c-4abb-9424-d137796216e4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:05.698442 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-659164f7-6b7c-4abb-9424-d137796216e4 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1505 microversion: 2.1 time: 0.435587 Jun 23 16:03:05.702866 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 152/297] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:05 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:06.193771 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-38396c9e-e6e5-46f9-bd04-bfb67b2c8211 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:06.195168 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-38396c9e-e6e5-46f9-bd04-bfb67b2c8211 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:06.203179 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38396c9e-e6e5-46f9-bd04-bfb67b2c8211 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:06.203917 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38396c9e-e6e5-46f9-bd04-bfb67b2c8211 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:06.204943 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38396c9e-e6e5-46f9-bd04-bfb67b2c8211 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:06.208634 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-38396c9e-e6e5-46f9-bd04-bfb67b2c8211 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:06.556885 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-38396c9e-e6e5-46f9-bd04-bfb67b2c8211 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:06.564366 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-38396c9e-e6e5-46f9-bd04-bfb67b2c8211 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.375823 Jun 23 16:03:06.565369 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 146/298] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:06 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:06.723426 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8d3f7569-c606-4e6e-9180-ec6ce8627fae tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:06.729313 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8d3f7569-c606-4e6e-9180-ec6ce8627fae tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:06.748068 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d3f7569-c606-4e6e-9180-ec6ce8627fae tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:06.748524 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d3f7569-c606-4e6e-9180-ec6ce8627fae tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:06.752679 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d3f7569-c606-4e6e-9180-ec6ce8627fae tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:06.753128 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d3f7569-c606-4e6e-9180-ec6ce8627fae tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:07.207553 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8d3f7569-c606-4e6e-9180-ec6ce8627fae tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:07.221432 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8d3f7569-c606-4e6e-9180-ec6ce8627fae tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1505 microversion: 2.1 time: 0.505074 Jun 23 16:03:07.222063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 153/299] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:06 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1505 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:07.583556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b87e6162-9117-4554-b2b2-35bd711c0359 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:07.584172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b87e6162-9117-4554-b2b2-35bd711c0359 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:07.593311 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b87e6162-9117-4554-b2b2-35bd711c0359 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:07.597863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b87e6162-9117-4554-b2b2-35bd711c0359 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:07.598995 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b87e6162-9117-4554-b2b2-35bd711c0359 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:07.599585 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b87e6162-9117-4554-b2b2-35bd711c0359 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:08.106130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b87e6162-9117-4554-b2b2-35bd711c0359 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:08.133665 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b87e6162-9117-4554-b2b2-35bd711c0359 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.554962 Jun 23 16:03:08.146677 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 147/300] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:07 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:08.238838 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-89adfcea-c099-46eb-845c-6dece150043e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:08.240487 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-89adfcea-c099-46eb-845c-6dece150043e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:08.253091 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89adfcea-c099-46eb-845c-6dece150043e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:08.257914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89adfcea-c099-46eb-845c-6dece150043e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:08.259240 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89adfcea-c099-46eb-845c-6dece150043e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:08.259918 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-89adfcea-c099-46eb-845c-6dece150043e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:08.594963 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-89adfcea-c099-46eb-845c-6dece150043e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:08.604812 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-89adfcea-c099-46eb-845c-6dece150043e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1505 microversion: 2.1 time: 0.369941 Jun 23 16:03:08.615616 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 154/301] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:08 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1505 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:09.154588 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a1c72b34-38d9-400b-a524-c5b67cbd3724 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:09.155170 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a1c72b34-38d9-400b-a524-c5b67cbd3724 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:09.167762 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1c72b34-38d9-400b-a524-c5b67cbd3724 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:09.168211 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1c72b34-38d9-400b-a524-c5b67cbd3724 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:09.168990 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1c72b34-38d9-400b-a524-c5b67cbd3724 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:09.175079 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1c72b34-38d9-400b-a524-c5b67cbd3724 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:09.556435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-1f49fa3c-4a48-4988-9940-c21c7884214d req-8242ea5b-2b49-4c81-8880-8a96f3a1b524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f8140b-9b15-4515-b3d5-feab25cb5f6b", "name": "network-vif-deleted", "tag": "f0f3facc-f04e-40f2-b6aa-01d0da39308f"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:09.601080 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-1f49fa3c-4a48-4988-9940-c21c7884214d req-8242ea5b-2b49-4c81-8880-8a96f3a1b524 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:09.605156 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-1f49fa3c-4a48-4988-9940-c21c7884214d req-8242ea5b-2b49-4c81-8880-8a96f3a1b524 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:09.664633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-1f49fa3c-4a48-4988-9940-c21c7884214d req-8242ea5b-2b49-4c81-8880-8a96f3a1b524 service nova] Creating event network-vif-deleted:f0f3facc-f04e-40f2-b6aa-01d0da39308f for instance 17f8140b-9b15-4515-b3d5-feab25cb5f6b on hv-cinder-83538 Jun 23 16:03:09.681889 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-1f49fa3c-4a48-4988-9940-c21c7884214d req-8242ea5b-2b49-4c81-8880-8a96f3a1b524 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133602 Jun 23 16:03:09.686041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 155/302] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:03:09.695554 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5736e336-93ca-478d-b93a-e9803b500b5a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:09.696701 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5736e336-93ca-478d-b93a-e9803b500b5a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:09.723336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5736e336-93ca-478d-b93a-e9803b500b5a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:09.724418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5736e336-93ca-478d-b93a-e9803b500b5a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:09.730548 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5736e336-93ca-478d-b93a-e9803b500b5a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:09.733399 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5736e336-93ca-478d-b93a-e9803b500b5a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:09.887111 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5736e336-93ca-478d-b93a-e9803b500b5a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:09.905476 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5736e336-93ca-478d-b93a-e9803b500b5a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 200 len: 1299 microversion: 2.1 time: 0.216950 Jun 23 16:03:09.909285 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 156/303] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:09 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 1299 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:10.207661 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a1c72b34-38d9-400b-a524-c5b67cbd3724 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:10.228683 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a1c72b34-38d9-400b-a524-c5b67cbd3724 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 1.072656 Jun 23 16:03:10.229371 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 148/304] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:09 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:10.925130 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8c100143-3f42-4365-80b9-e28230b78e49 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:10.926627 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8c100143-3f42-4365-80b9-e28230b78e49 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: 17f8140b-9b15-4515-b3d5-feab25cb5f6b] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:10.943123 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c100143-3f42-4365-80b9-e28230b78e49 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:10.945971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c100143-3f42-4365-80b9-e28230b78e49 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:10.950161 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c100143-3f42-4365-80b9-e28230b78e49 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:10.957688 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c100143-3f42-4365-80b9-e28230b78e49 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:10.994342 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-8c100143-3f42-4365-80b9-e28230b78e49 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] HTTP exception thrown: Instance 17f8140b-9b15-4515-b3d5-feab25cb5f6b could not be found. Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8c100143-3f42-4365-80b9-e28230b78e49 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Request method failure captured: Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b HTTP/1.1 Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI6cFOjAgHATJ6OQXKxYV5rOT-6L6Ehm5rGI7KcuknB-9wRjP6rlq_bDHjugn_ybsfel26HXhAbffYEoI0FKGnPEwNdcg3wcEq3M_O8CkkYYOUmaQPBvGX46x7E179-nZjYiIQANAvcFCxKY2HaQayUkWCvv6H-ysIoJ7jbA9tR8v2Y Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: ab9c00b7758f45daa7063ee2327c59d0 Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesActionsTest-2078016804 Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:03:10.999848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ab9c00b7758f45daa7063ee2327c59d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ab9c00b7758f45daa7063ee2327c59d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ab9c00b7758f45daa7063ee2327c59d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ab9c00b7758f45daa7063ee2327c59d0"}]}] Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesActionsTest-2078016804 Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: ab9c00b7758f45daa7063ee2327c59d0 Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesActionsTest-2078016804 Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesActionsTest-2078016804-project Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: ad8dac501e254a8d9671083b7b7d413c Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesActionsTest-2078016804-project Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 17f8140b-9b15-4515-b3d5-feab25cb5f6b could not be found. Jun 23 16:03:11.001397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '17f8140b-9b15-4515-b3d5-feab25cb5f6b'} Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f8140b-9b15-4515-b3d5-feab25cb5f6b could not be found. Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:03:11.002260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f8140b-9b15-4515-b3d5-feab25cb5f6b could not be found. Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f8140b-9b15-4515-b3d5-feab25cb5f6b could not be found. Jun 23 16:03:11.003650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:03:11.006305 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8c100143-3f42-4365-80b9-e28230b78e49 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Returning 404 to user: Instance 17f8140b-9b15-4515-b3d5-feab25cb5f6b could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:03:11.010606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8c100143-3f42-4365-80b9-e28230b78e49 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b" status: 404 len: 111 microversion: 2.1 time: 0.090364 Jun 23 16:03:11.011736 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 157/305] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:10 2022] GET /compute/v2.1/servers/17f8140b-9b15-4515-b3d5-feab25cb5f6b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:03:11.246254 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-44ca3338-225f-46be-a599-59da2c36fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:11.248493 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-44ca3338-225f-46be-a599-59da2c36fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:11.263947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44ca3338-225f-46be-a599-59da2c36fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:11.271722 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44ca3338-225f-46be-a599-59da2c36fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:11.275629 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44ca3338-225f-46be-a599-59da2c36fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:11.276404 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44ca3338-225f-46be-a599-59da2c36fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:11.323702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1023580729", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "networks": [{"uuid": "1a2e4d24-575a-4d10-8176-da6099ea152d"}]}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:11.456171 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] validate_networks() for [('1a2e4d24-575a-4d10-8176-da6099ea152d', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:03:11.999048 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-44ca3338-225f-46be-a599-59da2c36fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:12.041991 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-44ca3338-225f-46be-a599-59da2c36fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.790963 Jun 23 16:03:12.050663 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 149/306] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:11 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:12.948871 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:03:12.949398 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:03:12.949978 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:03:12.950491 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:03:12.951165 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:03:12.963257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:12.966576 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:12.967815 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:12.969877 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:13.002880 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Getting quotas for project ab9c00b7758f45daa7063ee2327c59d0. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:03:13.014147 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Getting quotas for user ad8dac501e254a8d9671083b7b7d413c and project ab9c00b7758f45daa7063ee2327c59d0. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:03:13.055641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:03:13.060260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:03:13.067442 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e2c63f63-61dc-4537-b1c4-2d606f633473 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:13.068597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e2c63f63-61dc-4537-b1c4-2d606f633473 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:13.083145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2c63f63-61dc-4537-b1c4-2d606f633473 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:13.083876 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2c63f63-61dc-4537-b1c4-2d606f633473 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:13.084814 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2c63f63-61dc-4537-b1c4-2d606f633473 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:13.085458 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2c63f63-61dc-4537-b1c4-2d606f633473 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:13.222880 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-78394560-96c1-4add-bd37-10006ca54c44 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901970 Jun 23 16:03:13.228540 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 158/307] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:03:13.234106 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c8f04735-9ca4-4add-9118-ba51f1e663e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:13.235288 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c8f04735-9ca4-4add-9118-ba51f1e663e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:13.425297 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c8f04735-9ca4-4add-9118-ba51f1e663e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:13.448245 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c8f04735-9ca4-4add-9118-ba51f1e663e2 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1214 microversion: 2.1 time: 0.218216 Jun 23 16:03:13.459179 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 159/308] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:13 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1214 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:13.846912 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e2c63f63-61dc-4537-b1c4-2d606f633473 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:13.867045 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e2c63f63-61dc-4537-b1c4-2d606f633473 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.801781 Jun 23 16:03:13.869365 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 150/309] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:13 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:14.467532 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1163b9ef-bd1b-4ae8-8983-9369c9b2af9a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:14.468267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1163b9ef-bd1b-4ae8-8983-9369c9b2af9a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:14.478347 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1163b9ef-bd1b-4ae8-8983-9369c9b2af9a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:14.478975 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1163b9ef-bd1b-4ae8-8983-9369c9b2af9a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:14.479768 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1163b9ef-bd1b-4ae8-8983-9369c9b2af9a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:14.487315 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1163b9ef-bd1b-4ae8-8983-9369c9b2af9a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:14.633008 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1163b9ef-bd1b-4ae8-8983-9369c9b2af9a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:14.645421 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1163b9ef-bd1b-4ae8-8983-9369c9b2af9a tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1218 microversion: 2.1 time: 0.178290 Jun 23 16:03:14.647772 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 151/310] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:14 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1218 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:14.910259 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fe23f709-a100-4a8d-b436-1d531f12dfe9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'create', calling method: .version_select at 0x7fe28dfd7790>, body: {"keypair": {"name": "tempest-keypair-1294029258", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPY4UcBA0bhaR8xVKsYpApAz64e5/feseukLuijsGsqo5Bb1xZ9MA1VlvlNWATm+ahIgk/JAhgUcWotSVqPwILFZ+u6+Qwr1T3VjfKprcqPiISDm8FNp/BQ8pbNwEYTGoQ=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:14.922330 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cc6d4c19-9894-48ac-be64-35a904557234 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Action: 'create', calling method: .version_select at 0x7fe28d5c39d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-483265151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBip3mu6POOES8LQmFBGjVBi+NGYuJs/rcnH6FHDjNkYKJLirA8sT/uqVz9ZgBzB6GDWYELLvZXOdeXITwqzmh2TSNGjWoY9vs4DWVtogeRqEqKLrbTtPq4p/c7yxNeO+Q=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:14.960909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-cc6d4c19-9894-48ac-be64-35a904557234 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Getting quotas for project bbde90b595244aef82fd4d52d4abfaa8. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:03:14.961975 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-fe23f709-a100-4a8d-b436-1d531f12dfe9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Getting quotas for project 3e09ed68cdf94f5a83ae9581419aa876. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:03:14.967673 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-cc6d4c19-9894-48ac-be64-35a904557234 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Getting quotas for user 2399b4fc64f74475bd8dc7b1634a2c2a and project bbde90b595244aef82fd4d52d4abfaa8. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:03:14.970748 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-fe23f709-a100-4a8d-b436-1d531f12dfe9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Getting quotas for user b423368e84084ac89334f13b723c6b31 and project 3e09ed68cdf94f5a83ae9581419aa876. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:03:14.999532 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cc6d4c19-9894-48ac-be64-35a904557234 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.582443 Jun 23 16:03:15.000214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 160/311] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 23 16:03:14 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:03:15.021882 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d05c7d00-4e74-4c19-b4c5-afa1d66ff58e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:15.023595 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d05c7d00-4e74-4c19-b4c5-afa1d66ff58e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:15.036141 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d05c7d00-4e74-4c19-b4c5-afa1d66ff58e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:15.036970 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d05c7d00-4e74-4c19-b4c5-afa1d66ff58e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:15.039183 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d05c7d00-4e74-4c19-b4c5-afa1d66ff58e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:15.039790 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d05c7d00-4e74-4c19-b4c5-afa1d66ff58e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:15.040988 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fe23f709-a100-4a8d-b436-1d531f12dfe9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.391509 Jun 23 16:03:15.042196 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 152/312] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 23 16:03:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:03:15.385913 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d05c7d00-4e74-4c19-b4c5-afa1d66ff58e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:15.395173 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d05c7d00-4e74-4c19-b4c5-afa1d66ff58e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.392958 Jun 23 16:03:15.401845 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 161/313] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:15 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:15.665446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-08af5d00-bdaf-494a-9cbc-a5aa4d1d4dda tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:15.666071 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-08af5d00-bdaf-494a-9cbc-a5aa4d1d4dda tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:15.677285 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-08af5d00-bdaf-494a-9cbc-a5aa4d1d4dda tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:15.678068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-08af5d00-bdaf-494a-9cbc-a5aa4d1d4dda tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:15.679161 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-08af5d00-bdaf-494a-9cbc-a5aa4d1d4dda tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:15.679786 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-08af5d00-bdaf-494a-9cbc-a5aa4d1d4dda tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:15.779016 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-08af5d00-bdaf-494a-9cbc-a5aa4d1d4dda tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:15.787455 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-08af5d00-bdaf-494a-9cbc-a5aa4d1d4dda tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1266 microversion: 2.1 time: 0.126959 Jun 23 16:03:15.790095 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 153/314] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:15 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1266 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:16.422509 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f3c73d2a-e23a-4b94-883e-28dd89791707 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:16.423358 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f3c73d2a-e23a-4b94-883e-28dd89791707 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:16.433438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3c73d2a-e23a-4b94-883e-28dd89791707 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:16.434060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3c73d2a-e23a-4b94-883e-28dd89791707 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:16.435869 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3c73d2a-e23a-4b94-883e-28dd89791707 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:16.436741 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3c73d2a-e23a-4b94-883e-28dd89791707 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:16.660139 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f3c73d2a-e23a-4b94-883e-28dd89791707 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:16.674505 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f3c73d2a-e23a-4b94-883e-28dd89791707 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.259429 Jun 23 16:03:16.675457 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 162/315] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:16 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:16.808573 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fdbcaca2-71d1-4c37-b972-2f1bbee85f5e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:16.809197 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fdbcaca2-71d1-4c37-b972-2f1bbee85f5e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:16.820790 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fdbcaca2-71d1-4c37-b972-2f1bbee85f5e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:16.821200 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fdbcaca2-71d1-4c37-b972-2f1bbee85f5e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:16.821975 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fdbcaca2-71d1-4c37-b972-2f1bbee85f5e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:16.822427 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fdbcaca2-71d1-4c37-b972-2f1bbee85f5e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:16.952210 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fdbcaca2-71d1-4c37-b972-2f1bbee85f5e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:16.961108 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fdbcaca2-71d1-4c37-b972-2f1bbee85f5e tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1274 microversion: 2.1 time: 0.157405 Jun 23 16:03:16.961670 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 154/316] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:16 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:17.386418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1094146222", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cf406d0-423b-4264-bd93-a82d988eee3d"}], "security_groups": [{"name": "tempest-securitygroup--654429028"}], "key_name": "tempest-keypair-1294029258", "user_data": "}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:17.395514 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:17.579662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] validate_networks() for [('4cf406d0-423b-4264-bd93-a82d988eee3d', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:03:17.692872 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-33136226-1137-41c6-bc6e-614747ef39a0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:17.693826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-33136226-1137-41c6-bc6e-614747ef39a0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:17.712945 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33136226-1137-41c6-bc6e-614747ef39a0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:17.714598 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33136226-1137-41c6-bc6e-614747ef39a0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:17.716594 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33136226-1137-41c6-bc6e-614747ef39a0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:17.719296 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33136226-1137-41c6-bc6e-614747ef39a0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:18.483503 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-33136226-1137-41c6-bc6e-614747ef39a0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:18.492176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-33136226-1137-41c6-bc6e-614747ef39a0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.803331 Jun 23 16:03:18.502435 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 155/317] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:17 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:18.509545 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6eed6da1-981a-4404-acfd-82d7da6a1c4b tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:18.510465 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6eed6da1-981a-4404-acfd-82d7da6a1c4b tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:18.517482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eed6da1-981a-4404-acfd-82d7da6a1c4b tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:18.518483 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eed6da1-981a-4404-acfd-82d7da6a1c4b tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:18.519833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eed6da1-981a-4404-acfd-82d7da6a1c4b tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:18.520799 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6eed6da1-981a-4404-acfd-82d7da6a1c4b tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:18.625349 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6eed6da1-981a-4404-acfd-82d7da6a1c4b tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:18.634752 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6eed6da1-981a-4404-acfd-82d7da6a1c4b tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1272 microversion: 2.1 time: 0.130779 Jun 23 16:03:18.635550 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 156/318] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:18 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:18.644784 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:03:18.644784 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:03:18.644784 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:03:18.644784 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:03:18.644784 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:03:18.653426 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:18.654205 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:18.655247 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:18.655869 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:18.674787 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Getting quotas for project 3e09ed68cdf94f5a83ae9581419aa876. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:03:18.679913 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Getting quotas for user b423368e84084ac89334f13b723c6b31 and project 3e09ed68cdf94f5a83ae9581419aa876. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:03:18.692976 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:03:18.696247 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:03:18.774078 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-61d55ee4-4542-4426-b87d-bfa9869cb033 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.393729 Jun 23 16:03:18.775780 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 163/319] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:03:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:03:18.785996 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9d1bc97f-ed9e-4116-b478-920e94e01e2d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:18.787238 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9d1bc97f-ed9e-4116-b478-920e94e01e2d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:18.938173 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9d1bc97f-ed9e-4116-b478-920e94e01e2d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:18.948101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9d1bc97f-ed9e-4116-b478-920e94e01e2d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1238 microversion: 2.1 time: 0.166266 Jun 23 16:03:18.949205 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 157/320] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:18 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1238 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:19.514674 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c1d85644-e4fd-4c30-a305-f9349e2f970a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:19.515357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c1d85644-e4fd-4c30-a305-f9349e2f970a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:19.562589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1d85644-e4fd-4c30-a305-f9349e2f970a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:19.564880 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1d85644-e4fd-4c30-a305-f9349e2f970a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:19.567859 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1d85644-e4fd-4c30-a305-f9349e2f970a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:19.568575 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1d85644-e4fd-4c30-a305-f9349e2f970a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:19.653070 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4cb32503-fc92-4dd8-8a86-7ca5118b2f48 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:19.654517 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4cb32503-fc92-4dd8-8a86-7ca5118b2f48 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:19.672968 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cb32503-fc92-4dd8-8a86-7ca5118b2f48 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:19.672968 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cb32503-fc92-4dd8-8a86-7ca5118b2f48 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:19.675086 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cb32503-fc92-4dd8-8a86-7ca5118b2f48 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:19.675425 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4cb32503-fc92-4dd8-8a86-7ca5118b2f48 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:19.790031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:19.988513 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c1d85644-e4fd-4c30-a305-f9349e2f970a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:20.004050 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c1d85644-e4fd-4c30-a305-f9349e2f970a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.495617 Jun 23 16:03:20.010776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 164/321] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:19 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:20.022953 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cc751ec4-256b-43d0-9b60-9c6fdba471fa tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:20.023894 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cc751ec4-256b-43d0-9b60-9c6fdba471fa tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:20.036046 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cc751ec4-256b-43d0-9b60-9c6fdba471fa tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:20.042932 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cc751ec4-256b-43d0-9b60-9c6fdba471fa tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:20.048483 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cc751ec4-256b-43d0-9b60-9c6fdba471fa tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:20.051698 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cc751ec4-256b-43d0-9b60-9c6fdba471fa tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:20.062823 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:20.185102 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cc751ec4-256b-43d0-9b60-9c6fdba471fa tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:20.197405 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cc751ec4-256b-43d0-9b60-9c6fdba471fa tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1234 microversion: 2.1 time: 0.185054 Jun 23 16:03:20.198041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 165/322] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:20 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1234 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:20.252891 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4cb32503-fc92-4dd8-8a86-7ca5118b2f48 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:20.260678 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4cb32503-fc92-4dd8-8a86-7ca5118b2f48 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.612730 Jun 23 16:03:20.261258 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 158/323] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:19 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:21.034236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c959c5b9-26ee-4cd6-8a08-b97fbee6cd4e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:21.035736 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c959c5b9-26ee-4cd6-8a08-b97fbee6cd4e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:21.052979 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c959c5b9-26ee-4cd6-8a08-b97fbee6cd4e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.053730 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c959c5b9-26ee-4cd6-8a08-b97fbee6cd4e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.056914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c959c5b9-26ee-4cd6-8a08-b97fbee6cd4e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.057714 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c959c5b9-26ee-4cd6-8a08-b97fbee6cd4e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.225314 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-be3ecf4c-3cf6-4f8e-8b95-a0f28745c5f6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:21.225314 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-be3ecf4c-3cf6-4f8e-8b95-a0f28745c5f6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:21.225314 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:21.228446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-be3ecf4c-3cf6-4f8e-8b95-a0f28745c5f6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.230441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-be3ecf4c-3cf6-4f8e-8b95-a0f28745c5f6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.232120 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-be3ecf4c-3cf6-4f8e-8b95-a0f28745c5f6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.232917 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-be3ecf4c-3cf6-4f8e-8b95-a0f28745c5f6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.375768 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-be3ecf4c-3cf6-4f8e-8b95-a0f28745c5f6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:21.421468 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-be3ecf4c-3cf6-4f8e-8b95-a0f28745c5f6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1298 microversion: 2.1 time: 0.207878 Jun 23 16:03:21.423235 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 159/324] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:21 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1298 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:21.457197 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d5eff109-991c-44a4-83d7-f874e8542891 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:21.459191 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d5eff109-991c-44a4-83d7-f874e8542891 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:21.472554 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5eff109-991c-44a4-83d7-f874e8542891 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.472998 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5eff109-991c-44a4-83d7-f874e8542891 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.474909 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5eff109-991c-44a4-83d7-f874e8542891 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.476314 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5eff109-991c-44a4-83d7-f874e8542891 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.559922 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c959c5b9-26ee-4cd6-8a08-b97fbee6cd4e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:21.572662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c959c5b9-26ee-4cd6-8a08-b97fbee6cd4e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1502 microversion: 2.1 time: 0.546897 Jun 23 16:03:21.573260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 166/325] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:21 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1502 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:21.589586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d44e969d-a3da-481a-a39f-ffa82cdde887 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9def34a4-cb22-4570-b7c3-1c89fcb121f9"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:21.590865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d44e969d-a3da-481a-a39f-ffa82cdde887 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:21.602998 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d44e969d-a3da-481a-a39f-ffa82cdde887 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.609156 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d44e969d-a3da-481a-a39f-ffa82cdde887 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.610281 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d44e969d-a3da-481a-a39f-ffa82cdde887 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.610920 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d44e969d-a3da-481a-a39f-ffa82cdde887 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.653947 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-d44e969d-a3da-481a-a39f-ffa82cdde887 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] HTTP exception thrown: Cannot 'attach_volume' instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 while it is in vm_state rescued Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d44e969d-a3da-481a-a39f-ffa82cdde887 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Request method failure captured: Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: POST /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134/os-volume_attachments HTTP/1.1 Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 74 Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4982N4I_q1MLhQUv7y__IsTVoVc_C4A24OIRUWCLxOkcQRrieSI2Pgytioaui_Pr0ZQoJFeqaHf1eDAR_1T3_jnmf7FblklhXX0H_LWu40tqQfHG6AN_wxK_-rLlHUEZPc4McdEJGI7Ye5KaaAaL_t5OM8F7CV92nevHTHOuzjgeg Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: f9eeca1030964294b8d813812abdcc5b Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:03:21.656312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f9eeca1030964294b8d813812abdcc5b"}]}] Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: f9eeca1030964294b8d813812abdcc5b Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-ServerRescueNegativeTestJSON-494893856-project Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: 228e5acf4578494ab1a28e4f530233f2 Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-ServerRescueNegativeTestJSON-494893856-project Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {"volumeAttachment": {"volumeId": "9def34a4-cb22-4570-b7c3-1c89fcb121f9"}} Jun 23 16:03:21.657536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Cannot 'attach_volume' instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 while it is in vm_state rescued Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'server_id': '030dcf0e-dfb9-4e58-a617-f6330ae03134', 'body': {'volumeAttachment': {'volumeId': '9def34a4-cb22-4570-b7c3-1c89fcb121f9'}}} Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:03:21.658254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 while it is in vm_state rescued Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:03:21.659357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:03:21.660386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:03:21.660386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:03:21.660386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 while it is in vm_state rescued Jun 23 16:03:21.660386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:03:21.660386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d44e969d-a3da-481a-a39f-ffa82cdde887 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Returning 409 to user: Cannot 'attach_volume' instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 while it is in vm_state rescued {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:03:21.660386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d44e969d-a3da-481a-a39f-ffa82cdde887 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.072481 Jun 23 16:03:21.662555 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 167/326] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:03:21 2022] POST /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134/os-volume_attachments => generated 152 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 23 16:03:21.668034 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-026e5157-b623-455a-94bc-bbdb852320ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:21.668812 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-026e5157-b623-455a-94bc-bbdb852320ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:21.675758 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-026e5157-b623-455a-94bc-bbdb852320ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.676468 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-026e5157-b623-455a-94bc-bbdb852320ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.677329 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-026e5157-b623-455a-94bc-bbdb852320ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.677836 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-026e5157-b623-455a-94bc-bbdb852320ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.775377 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d5eff109-991c-44a4-83d7-f874e8542891 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:21.784362 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d5eff109-991c-44a4-83d7-f874e8542891 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.359613 Jun 23 16:03:21.784948 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 160/327] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:21 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:21.813362 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-026e5157-b623-455a-94bc-bbdb852320ac tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134/action" status: 202 len: 0 microversion: 2.1 time: 0.149065 Jun 23 16:03:21.823622 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 168/328] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:03:21 2022] POST /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:03:21.824245 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4205de01-fe11-4065-b4ec-04399d04cadc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:21.824867 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4205de01-fe11-4065-b4ec-04399d04cadc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:21.835805 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4205de01-fe11-4065-b4ec-04399d04cadc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.836322 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4205de01-fe11-4065-b4ec-04399d04cadc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.839088 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4205de01-fe11-4065-b4ec-04399d04cadc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:21.841019 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4205de01-fe11-4065-b4ec-04399d04cadc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:21.999721 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-d65f6e25-2151-4e0c-86e9-9ade7c954dea req-986b4bcd-8232-48eb-8737-6bcfdde08a28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f380ec83-a90b-43af-9c6e-482630bd16d5", "tag": "9287fcca-b534-4b3e-ba8c-61a2ae3a7d2b"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:22.019440 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-d65f6e25-2151-4e0c-86e9-9ade7c954dea req-986b4bcd-8232-48eb-8737-6bcfdde08a28 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:22.019893 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-d65f6e25-2151-4e0c-86e9-9ade7c954dea req-986b4bcd-8232-48eb-8737-6bcfdde08a28 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:22.052502 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-d65f6e25-2151-4e0c-86e9-9ade7c954dea req-986b4bcd-8232-48eb-8737-6bcfdde08a28 service nova] Creating event network-changed:9287fcca-b534-4b3e-ba8c-61a2ae3a7d2b for instance f380ec83-a90b-43af-9c6e-482630bd16d5 on hv-cinder-83538 Jun 23 16:03:22.061879 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-d65f6e25-2151-4e0c-86e9-9ade7c954dea req-986b4bcd-8232-48eb-8737-6bcfdde08a28 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070341 Jun 23 16:03:22.063283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 169/329] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:03:22.214839 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4205de01-fe11-4065-b4ec-04399d04cadc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:22.234149 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4205de01-fe11-4065-b4ec-04399d04cadc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1510 microversion: 2.1 time: 0.414755 Jun 23 16:03:22.234829 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 161/330] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:21 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1510 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:22.449490 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-174570b7-537d-44e7-9bad-067465c034ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:22.450180 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-174570b7-537d-44e7-9bad-067465c034ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:22.464400 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-174570b7-537d-44e7-9bad-067465c034ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:22.472984 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-174570b7-537d-44e7-9bad-067465c034ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:22.473969 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-174570b7-537d-44e7-9bad-067465c034ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:22.474551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-174570b7-537d-44e7-9bad-067465c034ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:22.663385 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-174570b7-537d-44e7-9bad-067465c034ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:22.675155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-174570b7-537d-44e7-9bad-067465c034ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1296 microversion: 2.1 time: 0.227212 Jun 23 16:03:22.675996 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 170/331] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:22 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1296 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:22.801409 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6bb46cd2-48bb-4a5d-855f-154755f4e504 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:22.802333 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6bb46cd2-48bb-4a5d-855f-154755f4e504 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:22.809871 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6bb46cd2-48bb-4a5d-855f-154755f4e504 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:22.810324 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6bb46cd2-48bb-4a5d-855f-154755f4e504 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:22.811131 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6bb46cd2-48bb-4a5d-855f-154755f4e504 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:22.811565 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6bb46cd2-48bb-4a5d-855f-154755f4e504 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:22.982753 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6bb46cd2-48bb-4a5d-855f-154755f4e504 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:22.993539 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6bb46cd2-48bb-4a5d-855f-154755f4e504 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.195936 Jun 23 16:03:23.003937 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 162/332] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:22 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:23.252500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0c5907a3-8e89-426f-88fd-22b4345329fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:23.253303 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0c5907a3-8e89-426f-88fd-22b4345329fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:23.263409 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0c5907a3-8e89-426f-88fd-22b4345329fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:23.263961 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0c5907a3-8e89-426f-88fd-22b4345329fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:23.264635 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0c5907a3-8e89-426f-88fd-22b4345329fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:23.265071 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0c5907a3-8e89-426f-88fd-22b4345329fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:23.426979 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0c5907a3-8e89-426f-88fd-22b4345329fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:23.435250 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0c5907a3-8e89-426f-88fd-22b4345329fa tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1510 microversion: 2.1 time: 0.186760 Jun 23 16:03:23.435819 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 171/333] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:23 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:23.692679 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-13d15bc9-1661-4d0c-809d-0524975b6be3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:23.693223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-13d15bc9-1661-4d0c-809d-0524975b6be3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:23.699773 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-13d15bc9-1661-4d0c-809d-0524975b6be3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:23.700224 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-13d15bc9-1661-4d0c-809d-0524975b6be3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:23.700993 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-13d15bc9-1661-4d0c-809d-0524975b6be3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:23.701430 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-13d15bc9-1661-4d0c-809d-0524975b6be3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:23.855211 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-13d15bc9-1661-4d0c-809d-0524975b6be3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:23.863332 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-13d15bc9-1661-4d0c-809d-0524975b6be3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.174680 Jun 23 16:03:23.863906 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 163/334] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:23 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:24.011299 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b197de1d-2b12-40b3-a362-1ccffcc3af36 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:24.012041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b197de1d-2b12-40b3-a362-1ccffcc3af36 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:24.019011 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b197de1d-2b12-40b3-a362-1ccffcc3af36 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:24.019455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b197de1d-2b12-40b3-a362-1ccffcc3af36 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:24.020234 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b197de1d-2b12-40b3-a362-1ccffcc3af36 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:24.020680 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b197de1d-2b12-40b3-a362-1ccffcc3af36 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:24.184441 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b197de1d-2b12-40b3-a362-1ccffcc3af36 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:24.192330 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b197de1d-2b12-40b3-a362-1ccffcc3af36 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.185516 Jun 23 16:03:24.192909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 172/335] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:24 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:24.454775 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-39b08e98-f0c3-4a02-857d-1d646be1bf2d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:24.455574 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-39b08e98-f0c3-4a02-857d-1d646be1bf2d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:24.462022 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39b08e98-f0c3-4a02-857d-1d646be1bf2d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:24.462462 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39b08e98-f0c3-4a02-857d-1d646be1bf2d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:24.463499 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39b08e98-f0c3-4a02-857d-1d646be1bf2d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:24.463930 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-39b08e98-f0c3-4a02-857d-1d646be1bf2d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:24.593333 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-39b08e98-f0c3-4a02-857d-1d646be1bf2d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:24.600745 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-39b08e98-f0c3-4a02-857d-1d646be1bf2d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1510 microversion: 2.1 time: 0.150683 Jun 23 16:03:24.601317 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 164/336] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:24 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:24.880633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1b3a55c6-0d2a-4a51-b4b1-2bd960fc6e32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:24.881241 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1b3a55c6-0d2a-4a51-b4b1-2bd960fc6e32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:24.888766 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b3a55c6-0d2a-4a51-b4b1-2bd960fc6e32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:24.889184 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b3a55c6-0d2a-4a51-b4b1-2bd960fc6e32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:24.889951 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b3a55c6-0d2a-4a51-b4b1-2bd960fc6e32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:24.890395 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1b3a55c6-0d2a-4a51-b4b1-2bd960fc6e32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:25.025145 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1b3a55c6-0d2a-4a51-b4b1-2bd960fc6e32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:25.034391 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1b3a55c6-0d2a-4a51-b4b1-2bd960fc6e32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.157844 Jun 23 16:03:25.034994 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 173/337] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:24 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:25.209418 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7a5ec280-7c20-4eba-8262-8e4026e5a781 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:25.210610 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7a5ec280-7c20-4eba-8262-8e4026e5a781 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:25.217375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a5ec280-7c20-4eba-8262-8e4026e5a781 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:25.217897 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a5ec280-7c20-4eba-8262-8e4026e5a781 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:25.218755 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a5ec280-7c20-4eba-8262-8e4026e5a781 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:25.219197 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7a5ec280-7c20-4eba-8262-8e4026e5a781 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:25.355727 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7a5ec280-7c20-4eba-8262-8e4026e5a781 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:25.363098 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7a5ec280-7c20-4eba-8262-8e4026e5a781 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.157571 Jun 23 16:03:25.363655 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 165/338] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:25 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:25.618044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fcdc1971-a80d-4fcd-ab45-0682a82d0c1e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:25.618551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fcdc1971-a80d-4fcd-ab45-0682a82d0c1e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:25.624848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fcdc1971-a80d-4fcd-ab45-0682a82d0c1e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:25.625384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fcdc1971-a80d-4fcd-ab45-0682a82d0c1e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:25.626221 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fcdc1971-a80d-4fcd-ab45-0682a82d0c1e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:25.626673 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fcdc1971-a80d-4fcd-ab45-0682a82d0c1e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:25.766561 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fcdc1971-a80d-4fcd-ab45-0682a82d0c1e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:25.775388 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fcdc1971-a80d-4fcd-ab45-0682a82d0c1e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1510 microversion: 2.1 time: 0.161023 Jun 23 16:03:25.776048 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 174/339] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:25 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:26.051751 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-61bfa20b-9621-4dae-a685-ed39a46b6a76 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:26.052165 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-61bfa20b-9621-4dae-a685-ed39a46b6a76 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:26.058936 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61bfa20b-9621-4dae-a685-ed39a46b6a76 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:26.059388 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61bfa20b-9621-4dae-a685-ed39a46b6a76 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:26.060158 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61bfa20b-9621-4dae-a685-ed39a46b6a76 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:26.060593 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61bfa20b-9621-4dae-a685-ed39a46b6a76 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:26.187593 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-61bfa20b-9621-4dae-a685-ed39a46b6a76 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:26.195514 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-61bfa20b-9621-4dae-a685-ed39a46b6a76 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.147299 Jun 23 16:03:26.196069 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 166/340] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:26 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:26.385152 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2a4acb97-3d84-474c-bbac-4863288af580 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:26.385797 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2a4acb97-3d84-474c-bbac-4863288af580 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:26.392064 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2a4acb97-3d84-474c-bbac-4863288af580 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:26.392459 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2a4acb97-3d84-474c-bbac-4863288af580 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:26.393226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2a4acb97-3d84-474c-bbac-4863288af580 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:26.393685 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2a4acb97-3d84-474c-bbac-4863288af580 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:26.689830 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2a4acb97-3d84-474c-bbac-4863288af580 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:26.698150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2a4acb97-3d84-474c-bbac-4863288af580 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.321829 Jun 23 16:03:26.699090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 175/341] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:26 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:26.795013 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bca5ac38-14a0-4ef8-9a01-be86ae8bcb73 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:26.796307 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bca5ac38-14a0-4ef8-9a01-be86ae8bcb73 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:26.802975 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bca5ac38-14a0-4ef8-9a01-be86ae8bcb73 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:26.803801 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bca5ac38-14a0-4ef8-9a01-be86ae8bcb73 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:26.804838 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bca5ac38-14a0-4ef8-9a01-be86ae8bcb73 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:26.805796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bca5ac38-14a0-4ef8-9a01-be86ae8bcb73 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:27.007537 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bca5ac38-14a0-4ef8-9a01-be86ae8bcb73 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:27.015782 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bca5ac38-14a0-4ef8-9a01-be86ae8bcb73 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1510 microversion: 2.1 time: 0.224681 Jun 23 16:03:27.016947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 167/342] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:26 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:27.214672 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-caf4448b-f8e7-482e-99e6-c36c8525df60 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:27.215316 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-caf4448b-f8e7-482e-99e6-c36c8525df60 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:27.223262 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-caf4448b-f8e7-482e-99e6-c36c8525df60 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:27.223713 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-caf4448b-f8e7-482e-99e6-c36c8525df60 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:27.224499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-caf4448b-f8e7-482e-99e6-c36c8525df60 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:27.224938 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-caf4448b-f8e7-482e-99e6-c36c8525df60 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:27.407296 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-2b8632fd-1860-48d1-980a-f740ebdcabb0 req-32409272-6de5-4838-b2c7-ab9acadfdc3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f780c86-8efc-4e87-be01-8cc68d03e036", "tag": "d0385da0-a330-4afb-a25d-690b7056b15d"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:27.415636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2b8632fd-1860-48d1-980a-f740ebdcabb0 req-32409272-6de5-4838-b2c7-ab9acadfdc3a service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:27.416096 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2b8632fd-1860-48d1-980a-f740ebdcabb0 req-32409272-6de5-4838-b2c7-ab9acadfdc3a service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:27.429866 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-2b8632fd-1860-48d1-980a-f740ebdcabb0 req-32409272-6de5-4838-b2c7-ab9acadfdc3a service nova] Creating event network-changed:d0385da0-a330-4afb-a25d-690b7056b15d for instance 8f780c86-8efc-4e87-be01-8cc68d03e036 on hv-cinder-83538 Jun 23 16:03:27.441280 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-2b8632fd-1860-48d1-980a-f740ebdcabb0 req-32409272-6de5-4838-b2c7-ab9acadfdc3a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037765 Jun 23 16:03:27.457193 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-caf4448b-f8e7-482e-99e6-c36c8525df60 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:27.463611 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 168/343] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:03:27.465037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-caf4448b-f8e7-482e-99e6-c36c8525df60 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.257054 Jun 23 16:03:27.465650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 176/344] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:27 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:27.716356 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f3519082-383c-451f-86c2-3748131eccb5 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:27.717191 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f3519082-383c-451f-86c2-3748131eccb5 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:27.723593 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3519082-383c-451f-86c2-3748131eccb5 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:27.724112 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3519082-383c-451f-86c2-3748131eccb5 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:27.724965 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3519082-383c-451f-86c2-3748131eccb5 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:27.725469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3519082-383c-451f-86c2-3748131eccb5 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:27.875036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f3519082-383c-451f-86c2-3748131eccb5 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:27.883303 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f3519082-383c-451f-86c2-3748131eccb5 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.171092 Jun 23 16:03:27.883861 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 169/345] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:27 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:28.033557 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f224540e-470b-4893-b7bc-9cbce6dde832 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:28.034320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f224540e-470b-4893-b7bc-9cbce6dde832 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:28.041195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f224540e-470b-4893-b7bc-9cbce6dde832 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:28.041646 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f224540e-470b-4893-b7bc-9cbce6dde832 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:28.042418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f224540e-470b-4893-b7bc-9cbce6dde832 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:28.042912 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f224540e-470b-4893-b7bc-9cbce6dde832 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:28.176293 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f224540e-470b-4893-b7bc-9cbce6dde832 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:28.184408 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f224540e-470b-4893-b7bc-9cbce6dde832 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1510 microversion: 2.1 time: 0.154919 Jun 23 16:03:28.184973 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 177/346] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:28 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:28.482305 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c810362f-08c5-4415-928a-2c627a5f2778 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:28.483130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c810362f-08c5-4415-928a-2c627a5f2778 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:28.489375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c810362f-08c5-4415-928a-2c627a5f2778 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:28.489811 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c810362f-08c5-4415-928a-2c627a5f2778 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:28.490557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c810362f-08c5-4415-928a-2c627a5f2778 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:28.491010 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c810362f-08c5-4415-928a-2c627a5f2778 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:28.630578 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c810362f-08c5-4415-928a-2c627a5f2778 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:28.638086 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c810362f-08c5-4415-928a-2c627a5f2778 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.160207 Jun 23 16:03:28.638766 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 170/347] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:28 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:28.901184 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e1f9e13b-d2a2-4145-8916-dcf5edb6c730 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:28.901783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e1f9e13b-d2a2-4145-8916-dcf5edb6c730 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:28.903747 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:28.904392 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=18 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:28.910107 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1f9e13b-d2a2-4145-8916-dcf5edb6c730 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:28.910548 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1f9e13b-d2a2-4145-8916-dcf5edb6c730 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:28.911334 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1f9e13b-d2a2-4145-8916-dcf5edb6c730 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:28.911768 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e1f9e13b-d2a2-4145-8916-dcf5edb6c730 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:29.052429 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e1f9e13b-d2a2-4145-8916-dcf5edb6c730 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:29.060395 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e1f9e13b-d2a2-4145-8916-dcf5edb6c730 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.164382 Jun 23 16:03:29.060955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 178/348] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:28 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:29.201600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bdc1733d-a658-4941-82fd-f865683fab7f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:29.202220 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bdc1733d-a658-4941-82fd-f865683fab7f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:29.204239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:29.209667 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bdc1733d-a658-4941-82fd-f865683fab7f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:29.210107 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bdc1733d-a658-4941-82fd-f865683fab7f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:29.210890 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bdc1733d-a658-4941-82fd-f865683fab7f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:29.211315 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bdc1733d-a658-4941-82fd-f865683fab7f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:29.347610 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bdc1733d-a658-4941-82fd-f865683fab7f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:29.355656 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bdc1733d-a658-4941-82fd-f865683fab7f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1510 microversion: 2.1 time: 0.157911 Jun 23 16:03:29.356214 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 171/349] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:29 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:29.655302 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bd6d59f8-b355-4a2b-b63a-1d58a0d4151a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:29.655900 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bd6d59f8-b355-4a2b-b63a-1d58a0d4151a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:29.661906 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd6d59f8-b355-4a2b-b63a-1d58a0d4151a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:29.662347 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd6d59f8-b355-4a2b-b63a-1d58a0d4151a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:29.663141 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd6d59f8-b355-4a2b-b63a-1d58a0d4151a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:29.664211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd6d59f8-b355-4a2b-b63a-1d58a0d4151a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:29.793466 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bd6d59f8-b355-4a2b-b63a-1d58a0d4151a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:29.801695 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bd6d59f8-b355-4a2b-b63a-1d58a0d4151a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.150313 Jun 23 16:03:29.802268 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 179/350] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:29 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:30.077922 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f2e7ee01-1341-4df7-873d-d350592a7774 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:30.078540 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f2e7ee01-1341-4df7-873d-d350592a7774 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:30.085101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f2e7ee01-1341-4df7-873d-d350592a7774 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:30.086236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f2e7ee01-1341-4df7-873d-d350592a7774 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:30.087063 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f2e7ee01-1341-4df7-873d-d350592a7774 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:30.087606 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f2e7ee01-1341-4df7-873d-d350592a7774 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:30.262942 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f2e7ee01-1341-4df7-873d-d350592a7774 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:30.282331 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-d19b7aaa-3e4b-4dfd-848c-3eddf71c0f1c req-5fe53eee-a16f-4417-97eb-2c2d32be0142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f380ec83-a90b-43af-9c6e-482630bd16d5", "name": "network-vif-plugged", "status": "completed", "tag": "9287fcca-b534-4b3e-ba8c-61a2ae3a7d2b"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:30.288212 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f2e7ee01-1341-4df7-873d-d350592a7774 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.213719 Jun 23 16:03:30.289287 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 172/351] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:30 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:30.304651 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-d19b7aaa-3e4b-4dfd-848c-3eddf71c0f1c req-5fe53eee-a16f-4417-97eb-2c2d32be0142 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:30.306922 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-d19b7aaa-3e4b-4dfd-848c-3eddf71c0f1c req-5fe53eee-a16f-4417-97eb-2c2d32be0142 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:30.323695 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-d19b7aaa-3e4b-4dfd-848c-3eddf71c0f1c req-5fe53eee-a16f-4417-97eb-2c2d32be0142 service nova] Creating event network-vif-plugged:9287fcca-b534-4b3e-ba8c-61a2ae3a7d2b for instance f380ec83-a90b-43af-9c6e-482630bd16d5 on hv-cinder-83538 Jun 23 16:03:30.330351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-d19b7aaa-3e4b-4dfd-848c-3eddf71c0f1c req-5fe53eee-a16f-4417-97eb-2c2d32be0142 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053119 Jun 23 16:03:30.331145 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 180/352] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:03:30.373701 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e2cf8b0a-7f14-4cd8-ba34-d6b7654da9a2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:30.374310 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e2cf8b0a-7f14-4cd8-ba34-d6b7654da9a2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:30.385968 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2cf8b0a-7f14-4cd8-ba34-d6b7654da9a2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:30.386424 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2cf8b0a-7f14-4cd8-ba34-d6b7654da9a2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:30.387236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2cf8b0a-7f14-4cd8-ba34-d6b7654da9a2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:30.387664 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2cf8b0a-7f14-4cd8-ba34-d6b7654da9a2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:30.545215 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e2cf8b0a-7f14-4cd8-ba34-d6b7654da9a2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:30.552897 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e2cf8b0a-7f14-4cd8-ba34-d6b7654da9a2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1510 microversion: 2.1 time: 0.182962 Jun 23 16:03:30.553484 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 173/353] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:30 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:30.821483 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-32e024f2-0fed-4323-a1c7-b6da0e6c7b7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:30.822117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-32e024f2-0fed-4323-a1c7-b6da0e6c7b7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:30.828574 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-32e024f2-0fed-4323-a1c7-b6da0e6c7b7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:30.829019 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-32e024f2-0fed-4323-a1c7-b6da0e6c7b7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:30.829771 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-32e024f2-0fed-4323-a1c7-b6da0e6c7b7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:30.830233 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-32e024f2-0fed-4323-a1c7-b6da0e6c7b7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:30.972269 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-32e024f2-0fed-4323-a1c7-b6da0e6c7b7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:30.981875 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-32e024f2-0fed-4323-a1c7-b6da0e6c7b7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.164630 Jun 23 16:03:30.982403 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 181/354] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:30 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:31.315428 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-07a4fe56-6e61-4c65-bff8-02aa93d50af6 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:31.316127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-07a4fe56-6e61-4c65-bff8-02aa93d50af6 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:31.322253 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07a4fe56-6e61-4c65-bff8-02aa93d50af6 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:31.322708 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07a4fe56-6e61-4c65-bff8-02aa93d50af6 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:31.323471 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07a4fe56-6e61-4c65-bff8-02aa93d50af6 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:31.323896 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07a4fe56-6e61-4c65-bff8-02aa93d50af6 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:31.468597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-07a4fe56-6e61-4c65-bff8-02aa93d50af6 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:31.476122 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-07a4fe56-6e61-4c65-bff8-02aa93d50af6 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.164536 Jun 23 16:03:31.476690 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 174/355] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:31 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:31.570556 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b6efea91-7ac4-487f-94be-576653dc29ef tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:31.571216 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b6efea91-7ac4-487f-94be-576653dc29ef tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:31.581000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b6efea91-7ac4-487f-94be-576653dc29ef tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:31.581458 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b6efea91-7ac4-487f-94be-576653dc29ef tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:31.582451 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b6efea91-7ac4-487f-94be-576653dc29ef tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:31.582924 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b6efea91-7ac4-487f-94be-576653dc29ef tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:31.599283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:31.722130 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b6efea91-7ac4-487f-94be-576653dc29ef tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:31.729731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b6efea91-7ac4-487f-94be-576653dc29ef tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1516 microversion: 2.1 time: 0.163538 Jun 23 16:03:31.730289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 182/356] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:31 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:31.997881 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e06df74f-b14f-49d3-a3fa-15eb5e0da4e3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:31.998848 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e06df74f-b14f-49d3-a3fa-15eb5e0da4e3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:32.009572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e06df74f-b14f-49d3-a3fa-15eb5e0da4e3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:32.009572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e06df74f-b14f-49d3-a3fa-15eb5e0da4e3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:32.009572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e06df74f-b14f-49d3-a3fa-15eb5e0da4e3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:32.009572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e06df74f-b14f-49d3-a3fa-15eb5e0da4e3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:32.143485 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e06df74f-b14f-49d3-a3fa-15eb5e0da4e3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:32.146824 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:32.152654 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e06df74f-b14f-49d3-a3fa-15eb5e0da4e3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.158654 Jun 23 16:03:32.153250 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 175/357] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:31 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:32.493360 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c272597e-ea78-44e5-b786-a26fb9be398c tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:32.493889 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c272597e-ea78-44e5-b786-a26fb9be398c tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:32.499984 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c272597e-ea78-44e5-b786-a26fb9be398c tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:32.500434 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c272597e-ea78-44e5-b786-a26fb9be398c tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:32.501197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c272597e-ea78-44e5-b786-a26fb9be398c tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:32.501634 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c272597e-ea78-44e5-b786-a26fb9be398c tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:32.647180 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c272597e-ea78-44e5-b786-a26fb9be398c tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:32.655594 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c272597e-ea78-44e5-b786-a26fb9be398c tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1314 microversion: 2.1 time: 0.166087 Jun 23 16:03:32.656180 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 183/358] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:32 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:33.172895 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a4fa562d-1a9f-44a4-ae13-4dbd0add17d1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:33.173498 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a4fa562d-1a9f-44a4-ae13-4dbd0add17d1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:33.180733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4fa562d-1a9f-44a4-ae13-4dbd0add17d1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:33.181182 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4fa562d-1a9f-44a4-ae13-4dbd0add17d1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:33.182012 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4fa562d-1a9f-44a4-ae13-4dbd0add17d1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:33.182444 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a4fa562d-1a9f-44a4-ae13-4dbd0add17d1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:33.332253 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a4fa562d-1a9f-44a4-ae13-4dbd0add17d1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:33.340555 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a4fa562d-1a9f-44a4-ae13-4dbd0add17d1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.171877 Jun 23 16:03:33.341130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 176/359] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:33 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:33.672680 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b45c882a-b84d-4e58-9687-f68476e8ee91 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:33.673299 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b45c882a-b84d-4e58-9687-f68476e8ee91 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:33.680653 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b45c882a-b84d-4e58-9687-f68476e8ee91 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:33.681105 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b45c882a-b84d-4e58-9687-f68476e8ee91 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:33.681874 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b45c882a-b84d-4e58-9687-f68476e8ee91 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:33.682314 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b45c882a-b84d-4e58-9687-f68476e8ee91 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:33.824679 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b45c882a-b84d-4e58-9687-f68476e8ee91 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:33.832295 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b45c882a-b84d-4e58-9687-f68476e8ee91 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1499 microversion: 2.1 time: 0.163553 Jun 23 16:03:33.832857 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 184/360] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:33 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:34.142978 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c4724167-4c86-4df6-b5c8-d29c09d3371e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'create', calling method: .version_select at 0x7fe28dfd3af0>, body: {"keypair": {"name": "tempest-keypair-1470841333", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTjaIOQc450fJxwjntf+wRLDBG6O2NTH/n5SIqD4YXK1Ubt9G17pqKq8Vgpxu81EkxgyZoB276fhO4rsuypwyvOA3WDUPXegA0G6zqjlbpfT6qVp6KFxnoA1exftQUiJQ=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:34.158450 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-c4724167-4c86-4df6-b5c8-d29c09d3371e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Getting quotas for project f9eeca1030964294b8d813812abdcc5b. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:03:34.162677 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-c4724167-4c86-4df6-b5c8-d29c09d3371e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Getting quotas for user 228e5acf4578494ab1a28e4f530233f2 and project f9eeca1030964294b8d813812abdcc5b. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:03:34.184625 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c4724167-4c86-4df6-b5c8-d29c09d3371e tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045663 Jun 23 16:03:34.185359 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 177/361] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 23 16:03:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:03:34.354436 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f77c7a13-636c-4243-9fe2-45335a89e971 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:34.354436 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f77c7a13-636c-4243-9fe2-45335a89e971 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:34.361043 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f77c7a13-636c-4243-9fe2-45335a89e971 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:34.361933 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f77c7a13-636c-4243-9fe2-45335a89e971 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:34.363045 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f77c7a13-636c-4243-9fe2-45335a89e971 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:34.363501 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f77c7a13-636c-4243-9fe2-45335a89e971 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:34.367651 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-79c3828f-475b-450e-96c1-025f9b0323fc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:34.380664 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-79c3828f-475b-450e-96c1-025f9b0323fc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:34.389727 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79c3828f-475b-450e-96c1-025f9b0323fc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:34.391294 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79c3828f-475b-450e-96c1-025f9b0323fc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:34.392320 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79c3828f-475b-450e-96c1-025f9b0323fc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:34.393290 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79c3828f-475b-450e-96c1-025f9b0323fc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:34.398734 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f77c7a13-636c-4243-9fe2-45335a89e971 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:03:34.481363 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f77c7a13-636c-4243-9fe2-45335a89e971 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 204 len: 0 microversion: 2.1 time: 0.134146 Jun 23 16:03:34.482056 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 185/362] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:03:34 2022] DELETE /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:03:34.490875 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6f26c796-57fc-4470-babb-ff6295e0ae25 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:34.491976 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6f26c796-57fc-4470-babb-ff6295e0ae25 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:34.497821 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f26c796-57fc-4470-babb-ff6295e0ae25 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:34.498274 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f26c796-57fc-4470-babb-ff6295e0ae25 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:34.499076 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f26c796-57fc-4470-babb-ff6295e0ae25 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:34.499511 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f26c796-57fc-4470-babb-ff6295e0ae25 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:34.615521 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-79c3828f-475b-450e-96c1-025f9b0323fc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:34.628986 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-79c3828f-475b-450e-96c1-025f9b0323fc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.273007 Jun 23 16:03:34.629913 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 178/363] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:34 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:34.648888 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6f26c796-57fc-4470-babb-ff6295e0ae25 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:34.666222 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6f26c796-57fc-4470-babb-ff6295e0ae25 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1505 microversion: 2.1 time: 0.176446 Jun 23 16:03:34.671135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 186/364] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:34 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:35.646917 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ae5212fd-6a05-45c1-be78-039f262f7caf tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:35.647531 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ae5212fd-6a05-45c1-be78-039f262f7caf tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:35.654758 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ae5212fd-6a05-45c1-be78-039f262f7caf tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:35.655207 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ae5212fd-6a05-45c1-be78-039f262f7caf tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:35.656000 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ae5212fd-6a05-45c1-be78-039f262f7caf tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:35.656417 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ae5212fd-6a05-45c1-be78-039f262f7caf tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:35.680769 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e280d23d-92ab-49b3-98d9-0c703fe78fb9 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:35.681377 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e280d23d-92ab-49b3-98d9-0c703fe78fb9 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:35.688324 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e280d23d-92ab-49b3-98d9-0c703fe78fb9 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:35.688771 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e280d23d-92ab-49b3-98d9-0c703fe78fb9 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:35.689540 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e280d23d-92ab-49b3-98d9-0c703fe78fb9 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:35.689974 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e280d23d-92ab-49b3-98d9-0c703fe78fb9 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:35.831022 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e280d23d-92ab-49b3-98d9-0c703fe78fb9 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:35.839438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e280d23d-92ab-49b3-98d9-0c703fe78fb9 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1505 microversion: 2.1 time: 0.162562 Jun 23 16:03:35.840018 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 187/365] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:35 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:35.885839 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ae5212fd-6a05-45c1-be78-039f262f7caf tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:35.893277 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ae5212fd-6a05-45c1-be78-039f262f7caf tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.250305 Jun 23 16:03:35.895012 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 179/366] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:35 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:35.962924 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-32623739", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be160518-64d3-490b-aa6f-8ddd417753d6"}], "security_groups": [{"name": "tempest-securitygroup--1620517652"}], "key_name": "tempest-keypair-1470841333", "user_data": "}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:36.068326 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] validate_networks() for [('be160518-64d3-490b-aa6f-8ddd417753d6', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:03:36.437365 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:03:36.437790 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:03:36.438296 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:03:36.438727 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:03:36.439145 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:03:36.448536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:36.448988 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:36.449802 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:36.450237 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:36.466968 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Getting quotas for project f9eeca1030964294b8d813812abdcc5b. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:03:36.470945 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Getting quotas for user 228e5acf4578494ab1a28e4f530233f2 and project f9eeca1030964294b8d813812abdcc5b. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:03:36.481849 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:03:36.484188 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:03:36.533438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f4c63ab9-e372-412f-93f8-1c1f725e1625 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.575488 Jun 23 16:03:36.534547 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 188/367] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:03:35 2022] POST /compute/v2.1/servers => generated 409 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:03:36.544755 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c691f38f-c3eb-475d-b2ec-89a1fa441eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:36.545609 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c691f38f-c3eb-475d-b2ec-89a1fa441eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:36.645186 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c691f38f-c3eb-475d-b2ec-89a1fa441eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:36.652357 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c691f38f-c3eb-475d-b2ec-89a1fa441eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1244 microversion: 2.1 time: 0.111928 Jun 23 16:03:36.659841 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 180/368] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:36 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1244 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:36.859681 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b7d9fb90-d4ae-4446-be50-4e550ee8ddd3 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:36.860433 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b7d9fb90-d4ae-4446-be50-4e550ee8ddd3 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:36.868029 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7d9fb90-d4ae-4446-be50-4e550ee8ddd3 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:36.868478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7d9fb90-d4ae-4446-be50-4e550ee8ddd3 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:36.870528 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7d9fb90-d4ae-4446-be50-4e550ee8ddd3 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:36.871334 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7d9fb90-d4ae-4446-be50-4e550ee8ddd3 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:36.910818 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-77553d6e-be68-4f92-bf24-30017d26a447 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:36.918170 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-77553d6e-be68-4f92-bf24-30017d26a447 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:36.928896 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-77553d6e-be68-4f92-bf24-30017d26a447 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:36.929857 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-77553d6e-be68-4f92-bf24-30017d26a447 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:36.933231 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-77553d6e-be68-4f92-bf24-30017d26a447 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:36.935846 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-77553d6e-be68-4f92-bf24-30017d26a447 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:36.940375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b7d9fb90-d4ae-4446-be50-4e550ee8ddd3 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:36.949531 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b7d9fb90-d4ae-4446-be50-4e550ee8ddd3 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1463 microversion: 2.1 time: 0.095918 Jun 23 16:03:36.950907 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 189/369] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:36 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1463 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:36.993887 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-78466e99-b8fd-499b-bd8b-432946962333 req-6c0b189d-c275-484e-9f1e-0dcaea70c66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f380ec83-a90b-43af-9c6e-482630bd16d5", "name": "network-vif-deleted", "tag": "9287fcca-b534-4b3e-ba8c-61a2ae3a7d2b"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:37.006020 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-78466e99-b8fd-499b-bd8b-432946962333 req-6c0b189d-c275-484e-9f1e-0dcaea70c66f service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:37.006888 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-78466e99-b8fd-499b-bd8b-432946962333 req-6c0b189d-c275-484e-9f1e-0dcaea70c66f service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:37.021535 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-78466e99-b8fd-499b-bd8b-432946962333 req-6c0b189d-c275-484e-9f1e-0dcaea70c66f service nova] Creating event network-vif-deleted:9287fcca-b534-4b3e-ba8c-61a2ae3a7d2b for instance f380ec83-a90b-43af-9c6e-482630bd16d5 on hv-cinder-83538 Jun 23 16:03:37.029302 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-78466e99-b8fd-499b-bd8b-432946962333 req-6c0b189d-c275-484e-9f1e-0dcaea70c66f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044236 Jun 23 16:03:37.030873 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 190/370] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:03:37.122169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-77553d6e-be68-4f92-bf24-30017d26a447 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:37.129512 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-77553d6e-be68-4f92-bf24-30017d26a447 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.222675 Jun 23 16:03:37.130096 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 181/371] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:36 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:37.670714 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-763a7667-bae4-4ea9-ab4d-656407b9a854 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:37.671757 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-763a7667-bae4-4ea9-ab4d-656407b9a854 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:37.678302 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-763a7667-bae4-4ea9-ab4d-656407b9a854 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:37.678795 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-763a7667-bae4-4ea9-ab4d-656407b9a854 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:37.679612 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-763a7667-bae4-4ea9-ab4d-656407b9a854 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:37.680054 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-763a7667-bae4-4ea9-ab4d-656407b9a854 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:37.744083 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-763a7667-bae4-4ea9-ab4d-656407b9a854 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:37.756300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-763a7667-bae4-4ea9-ab4d-656407b9a854 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1248 microversion: 2.1 time: 0.090449 Jun 23 16:03:37.757954 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 191/372] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:37 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:37.966820 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:37.967436 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:37.973375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:37.973823 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:37.974581 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:37.975065 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:38.005664 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:38.006101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:38.006544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lazy-loading 'fault' on Instance uuid f380ec83-a90b-43af-9c6e-482630bd16d5 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:03:38.050716 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:38.058134 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7f5fcc00-cc20-444b-a03e-f669935fcbf0 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1304 microversion: 2.1 time: 0.095180 Jun 23 16:03:38.058708 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 182/373] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:37 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:38.145652 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-012dd441-e16b-4155-af1a-22cb849259c1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:38.146188 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-012dd441-e16b-4155-af1a-22cb849259c1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:38.153510 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-012dd441-e16b-4155-af1a-22cb849259c1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:38.153959 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-012dd441-e16b-4155-af1a-22cb849259c1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:38.154746 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-012dd441-e16b-4155-af1a-22cb849259c1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:38.155192 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-012dd441-e16b-4155-af1a-22cb849259c1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:38.287986 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-012dd441-e16b-4155-af1a-22cb849259c1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:38.296028 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-012dd441-e16b-4155-af1a-22cb849259c1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.154290 Jun 23 16:03:38.296616 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 192/374] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:38 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:38.777457 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4d6926f8-5056-4e72-8d7f-e90c45521798 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:38.778065 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4d6926f8-5056-4e72-8d7f-e90c45521798 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:38.784096 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d6926f8-5056-4e72-8d7f-e90c45521798 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:38.784532 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d6926f8-5056-4e72-8d7f-e90c45521798 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:38.785280 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d6926f8-5056-4e72-8d7f-e90c45521798 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:38.785707 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d6926f8-5056-4e72-8d7f-e90c45521798 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:38.849980 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4d6926f8-5056-4e72-8d7f-e90c45521798 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:38.857412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4d6926f8-5056-4e72-8d7f-e90c45521798 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1248 microversion: 2.1 time: 0.084115 Jun 23 16:03:38.857972 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 183/375] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:38 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:39.075563 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:39.076181 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:39.082806 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:39.083255 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:39.084046 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:39.084484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:39.113459 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:39.120209 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:39.120655 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:39.121177 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lazy-loading 'fault' on Instance uuid f380ec83-a90b-43af-9c6e-482630bd16d5 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:03:39.171789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:39.180724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3b18c750-f2b6-4f2f-946e-d488cad0dd7d tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1304 microversion: 2.1 time: 0.108943 Jun 23 16:03:39.181422 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 193/376] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:39 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1304 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:39.313179 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-51559e5c-0e8a-4758-a865-aaf85a5ff0d7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:39.313778 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-51559e5c-0e8a-4758-a865-aaf85a5ff0d7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:39.320022 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51559e5c-0e8a-4758-a865-aaf85a5ff0d7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:39.320452 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51559e5c-0e8a-4758-a865-aaf85a5ff0d7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:39.321222 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51559e5c-0e8a-4758-a865-aaf85a5ff0d7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:39.321647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-51559e5c-0e8a-4758-a865-aaf85a5ff0d7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:39.460865 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-51559e5c-0e8a-4758-a865-aaf85a5ff0d7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:39.468339 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-51559e5c-0e8a-4758-a865-aaf85a5ff0d7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.159030 Jun 23 16:03:39.468898 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 184/377] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:39 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:39.874573 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-41de4aa6-af3e-4283-b602-3b3038e3e29b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:39.875217 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-41de4aa6-af3e-4283-b602-3b3038e3e29b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:39.881299 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-41de4aa6-af3e-4283-b602-3b3038e3e29b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:39.881748 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-41de4aa6-af3e-4283-b602-3b3038e3e29b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:39.885178 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-41de4aa6-af3e-4283-b602-3b3038e3e29b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:39.885607 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-41de4aa6-af3e-4283-b602-3b3038e3e29b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:39.951763 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-41de4aa6-af3e-4283-b602-3b3038e3e29b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:39.959178 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-41de4aa6-af3e-4283-b602-3b3038e3e29b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1248 microversion: 2.1 time: 0.088388 Jun 23 16:03:39.959669 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 194/378] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:39 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1248 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:40.198757 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:40.199371 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:40.205452 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:40.205900 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:40.207650 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:40.207650 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:40.238398 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:40.238783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:40.239230 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lazy-loading 'fault' on Instance uuid f380ec83-a90b-43af-9c6e-482630bd16d5 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:03:40.279676 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:40.287066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-530cd8ca-7441-49fd-9cf8-d191ad008c01 tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1304 microversion: 2.1 time: 0.092770 Jun 23 16:03:40.287630 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 185/379] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:40 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:40.485857 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a86790ca-cd5d-40bc-9274-7c48fac14e7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:40.486471 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a86790ca-cd5d-40bc-9274-7c48fac14e7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:40.493730 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a86790ca-cd5d-40bc-9274-7c48fac14e7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:40.494144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a86790ca-cd5d-40bc-9274-7c48fac14e7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:40.494972 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a86790ca-cd5d-40bc-9274-7c48fac14e7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:40.495493 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a86790ca-cd5d-40bc-9274-7c48fac14e7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:40.634492 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a86790ca-cd5d-40bc-9274-7c48fac14e7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:40.642000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a86790ca-cd5d-40bc-9274-7c48fac14e7e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.160099 Jun 23 16:03:40.642572 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 195/380] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:40 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:40.976647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8fa823f7-c6ae-481a-9e94-f5475bb2dcca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:40.977356 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8fa823f7-c6ae-481a-9e94-f5475bb2dcca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:40.983529 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8fa823f7-c6ae-481a-9e94-f5475bb2dcca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:40.983978 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8fa823f7-c6ae-481a-9e94-f5475bb2dcca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:40.984763 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8fa823f7-c6ae-481a-9e94-f5475bb2dcca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:40.985200 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8fa823f7-c6ae-481a-9e94-f5475bb2dcca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:41.051274 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8fa823f7-c6ae-481a-9e94-f5475bb2dcca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:41.059619 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8fa823f7-c6ae-481a-9e94-f5475bb2dcca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1240 microversion: 2.1 time: 0.087015 Jun 23 16:03:41.060183 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 186/381] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:40 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:41.304508 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:41.305796 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:41.312021 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:41.312555 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:41.313384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:41.313928 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:41.349425 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:41.349918 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:41.350525 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lazy-loading 'fault' on Instance uuid f380ec83-a90b-43af-9c6e-482630bd16d5 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:03:41.404535 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad8dac501e254a8d9671083b7b7d413c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab9c00b7758f45daa7063ee2327c59d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:41.412189 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6cff52fc-412d-4061-be6c-ab697fc430bb tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 200 len: 1304 microversion: 2.1 time: 0.112123 Jun 23 16:03:41.412886 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 196/382] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:41 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:41.659448 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e534f580-56f4-4ca0-b175-24b0d37fd48b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:41.660062 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e534f580-56f4-4ca0-b175-24b0d37fd48b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:41.667036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e534f580-56f4-4ca0-b175-24b0d37fd48b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:41.667484 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e534f580-56f4-4ca0-b175-24b0d37fd48b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:41.668246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e534f580-56f4-4ca0-b175-24b0d37fd48b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:41.668681 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e534f580-56f4-4ca0-b175-24b0d37fd48b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:41.814502 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e534f580-56f4-4ca0-b175-24b0d37fd48b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:41.822718 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e534f580-56f4-4ca0-b175-24b0d37fd48b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.167227 Jun 23 16:03:41.823538 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 187/383] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:41 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:42.080308 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-86ac1ed5-fe42-4151-ae6d-0e008b88a1d0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:42.085586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-86ac1ed5-fe42-4151-ae6d-0e008b88a1d0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:42.093646 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86ac1ed5-fe42-4151-ae6d-0e008b88a1d0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:42.094389 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86ac1ed5-fe42-4151-ae6d-0e008b88a1d0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:42.095203 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86ac1ed5-fe42-4151-ae6d-0e008b88a1d0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:42.095638 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86ac1ed5-fe42-4151-ae6d-0e008b88a1d0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:42.161406 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-86ac1ed5-fe42-4151-ae6d-0e008b88a1d0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:42.170018 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-86ac1ed5-fe42-4151-ae6d-0e008b88a1d0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1302 microversion: 2.1 time: 0.097061 Jun 23 16:03:42.170681 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 197/384] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:42 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1302 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:42.429615 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4f8dfe07-5c6b-4207-bcaf-8e7df9cb76cd tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:42.430921 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4f8dfe07-5c6b-4207-bcaf-8e7df9cb76cd tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] [instance: f380ec83-a90b-43af-9c6e-482630bd16d5] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:42.437695 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f8dfe07-5c6b-4207-bcaf-8e7df9cb76cd tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:42.438377 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f8dfe07-5c6b-4207-bcaf-8e7df9cb76cd tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:42.439328 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f8dfe07-5c6b-4207-bcaf-8e7df9cb76cd tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:42.439954 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f8dfe07-5c6b-4207-bcaf-8e7df9cb76cd tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:42.454446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-4f8dfe07-5c6b-4207-bcaf-8e7df9cb76cd tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] HTTP exception thrown: Instance f380ec83-a90b-43af-9c6e-482630bd16d5 could not be found. Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4f8dfe07-5c6b-4207-bcaf-8e7df9cb76cd tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Request method failure captured: Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 HTTP/1.1 Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI6cFOjAgHATJ6OQXKxYV5rOT-6L6Ehm5rGI7KcuknB-9wRjP6rlq_bDHjugn_ybsfel26HXhAbffYEoI0FKGnPEwNdcg3wcEq3M_O8CkkYYOUmaQPBvGX46x7E179-nZjYiIQANAvcFCxKY2HaQayUkWCvv6H-ysIoJ7jbA9tR8v2Y Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: ab9c00b7758f45daa7063ee2327c59d0 Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-VolumesActionsTest-2078016804 Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:03:42.456114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ab9c00b7758f45daa7063ee2327c59d0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/ab9c00b7758f45daa7063ee2327c59d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/ab9c00b7758f45daa7063ee2327c59d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_ab9c00b7758f45daa7063ee2327c59d0"}]}] Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-VolumesActionsTest-2078016804 Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: ab9c00b7758f45daa7063ee2327c59d0 Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-VolumesActionsTest-2078016804 Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-VolumesActionsTest-2078016804-project Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: ad8dac501e254a8d9671083b7b7d413c Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-VolumesActionsTest-2078016804-project Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance f380ec83-a90b-43af-9c6e-482630bd16d5 could not be found. Jun 23 16:03:42.458166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': 'f380ec83-a90b-43af-9c6e-482630bd16d5'} Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f380ec83-a90b-43af-9c6e-482630bd16d5 could not be found. Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:03:42.459137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f380ec83-a90b-43af-9c6e-482630bd16d5 could not be found. Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f380ec83-a90b-43af-9c6e-482630bd16d5 could not be found. Jun 23 16:03:42.460543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:03:42.462175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4f8dfe07-5c6b-4207-bcaf-8e7df9cb76cd tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] Returning 404 to user: Instance f380ec83-a90b-43af-9c6e-482630bd16d5 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:03:42.462175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4f8dfe07-5c6b-4207-bcaf-8e7df9cb76cd tempest-VolumesActionsTest-2078016804 tempest-VolumesActionsTest-2078016804-project] 10.222.0.46 "GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5" status: 404 len: 111 microversion: 2.1 time: 0.031824 Jun 23 16:03:42.463752 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 188/385] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:42 2022] GET /compute/v2.1/servers/f380ec83-a90b-43af-9c6e-482630bd16d5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:03:42.843303 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6ce3c51c-8062-407f-beaf-31a089f888ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:42.843927 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6ce3c51c-8062-407f-beaf-31a089f888ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:42.850463 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6ce3c51c-8062-407f-beaf-31a089f888ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:42.850981 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6ce3c51c-8062-407f-beaf-31a089f888ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:42.851793 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6ce3c51c-8062-407f-beaf-31a089f888ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:42.852234 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6ce3c51c-8062-407f-beaf-31a089f888ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:42.861577 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:43.053111 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6ce3c51c-8062-407f-beaf-31a089f888ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:43.060655 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6ce3c51c-8062-407f-beaf-31a089f888ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.224543 Jun 23 16:03:43.061463 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 198/386] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:42 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:43.187984 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-eefb6504-035b-401a-9dd0-d5cbf70c33ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:43.189359 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-eefb6504-035b-401a-9dd0-d5cbf70c33ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:43.197409 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eefb6504-035b-401a-9dd0-d5cbf70c33ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:43.197904 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eefb6504-035b-401a-9dd0-d5cbf70c33ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:43.199320 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eefb6504-035b-401a-9dd0-d5cbf70c33ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:43.199893 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-eefb6504-035b-401a-9dd0-d5cbf70c33ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:43.450923 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-eefb6504-035b-401a-9dd0-d5cbf70c33ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:43.458727 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-eefb6504-035b-401a-9dd0-d5cbf70c33ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.274767 Jun 23 16:03:43.459296 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 189/387] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:43 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:43.618892 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-28fa3d01-07ee-403e-bf31-1daf8fe43af6 req-479b6172-7042-42de-ac6c-f48b5b4ea7ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "649b033e-63c2-44c2-a597-4192007bb977", "tag": "c631e37e-f39c-4dd5-871a-90b0efe598ae"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:03:43.628199 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-28fa3d01-07ee-403e-bf31-1daf8fe43af6 req-479b6172-7042-42de-ac6c-f48b5b4ea7ed service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:43.628646 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-28fa3d01-07ee-403e-bf31-1daf8fe43af6 req-479b6172-7042-42de-ac6c-f48b5b4ea7ed service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:43.640422 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-28fa3d01-07ee-403e-bf31-1daf8fe43af6 req-479b6172-7042-42de-ac6c-f48b5b4ea7ed service nova] Creating event network-changed:c631e37e-f39c-4dd5-871a-90b0efe598ae for instance 649b033e-63c2-44c2-a597-4192007bb977 on hv-cinder-83538 Jun 23 16:03:43.645826 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-28fa3d01-07ee-403e-bf31-1daf8fe43af6 req-479b6172-7042-42de-ac6c-f48b5b4ea7ed service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031109 Jun 23 16:03:43.646435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 199/388] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:03:44.078428 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-637100af-d208-49ed-a128-4a0693b13e2c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:44.079161 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-637100af-d208-49ed-a128-4a0693b13e2c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:44.085156 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-637100af-d208-49ed-a128-4a0693b13e2c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:44.085611 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-637100af-d208-49ed-a128-4a0693b13e2c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:44.086991 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-637100af-d208-49ed-a128-4a0693b13e2c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:44.087424 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-637100af-d208-49ed-a128-4a0693b13e2c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:44.234497 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-637100af-d208-49ed-a128-4a0693b13e2c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:44.241863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-637100af-d208-49ed-a128-4a0693b13e2c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.167331 Jun 23 16:03:44.242426 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 190/389] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:44 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:44.476403 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5c7a8818-e345-4eaa-bbfe-5008ad67d3b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:44.477044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5c7a8818-e345-4eaa-bbfe-5008ad67d3b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:44.483299 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5c7a8818-e345-4eaa-bbfe-5008ad67d3b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:44.483751 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5c7a8818-e345-4eaa-bbfe-5008ad67d3b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:44.484511 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5c7a8818-e345-4eaa-bbfe-5008ad67d3b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:44.484954 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5c7a8818-e345-4eaa-bbfe-5008ad67d3b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:44.620170 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5c7a8818-e345-4eaa-bbfe-5008ad67d3b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:44.628175 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5c7a8818-e345-4eaa-bbfe-5008ad67d3b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.156180 Jun 23 16:03:44.628739 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 200/390] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:44 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:45.258429 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-80f93418-6f56-4b82-bdaf-4c705db2d032 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:45.259078 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-80f93418-6f56-4b82-bdaf-4c705db2d032 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:45.265000 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-80f93418-6f56-4b82-bdaf-4c705db2d032 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:45.265443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-80f93418-6f56-4b82-bdaf-4c705db2d032 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:45.266286 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-80f93418-6f56-4b82-bdaf-4c705db2d032 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:45.266836 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-80f93418-6f56-4b82-bdaf-4c705db2d032 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:45.400495 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-80f93418-6f56-4b82-bdaf-4c705db2d032 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:45.407962 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-80f93418-6f56-4b82-bdaf-4c705db2d032 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.153328 Jun 23 16:03:45.408526 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 191/391] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:45 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:45.645528 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6967bbd5-7683-427a-8d83-9bac7379c736 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:45.646315 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6967bbd5-7683-427a-8d83-9bac7379c736 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:45.654450 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6967bbd5-7683-427a-8d83-9bac7379c736 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:45.654983 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6967bbd5-7683-427a-8d83-9bac7379c736 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:45.655753 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6967bbd5-7683-427a-8d83-9bac7379c736 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:45.656186 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6967bbd5-7683-427a-8d83-9bac7379c736 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:45.790064 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6967bbd5-7683-427a-8d83-9bac7379c736 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:45.797579 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6967bbd5-7683-427a-8d83-9bac7379c736 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.155993 Jun 23 16:03:45.798144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 201/392] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:45 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:46.425772 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2e9c2342-8681-41d9-b254-dc074a8a3ca3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:46.426425 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2e9c2342-8681-41d9-b254-dc074a8a3ca3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:46.433902 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2e9c2342-8681-41d9-b254-dc074a8a3ca3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:46.434813 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2e9c2342-8681-41d9-b254-dc074a8a3ca3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:46.435042 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2e9c2342-8681-41d9-b254-dc074a8a3ca3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:46.435506 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2e9c2342-8681-41d9-b254-dc074a8a3ca3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:46.572852 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2e9c2342-8681-41d9-b254-dc074a8a3ca3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:46.581104 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2e9c2342-8681-41d9-b254-dc074a8a3ca3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.159208 Jun 23 16:03:46.581686 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 192/393] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:46 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:46.815265 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f2d4702f-ebee-43ac-bef5-d195bb7e2d9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:46.816683 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f2d4702f-ebee-43ac-bef5-d195bb7e2d9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:46.818995 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:46.819828 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=6 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:46.827868 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f2d4702f-ebee-43ac-bef5-d195bb7e2d9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:46.828326 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f2d4702f-ebee-43ac-bef5-d195bb7e2d9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:46.829293 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f2d4702f-ebee-43ac-bef5-d195bb7e2d9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:46.829733 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f2d4702f-ebee-43ac-bef5-d195bb7e2d9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:46.968468 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f2d4702f-ebee-43ac-bef5-d195bb7e2d9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:46.976776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f2d4702f-ebee-43ac-bef5-d195bb7e2d9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.165598 Jun 23 16:03:46.977420 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 202/394] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:46 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:47.597464 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e6dc1e63-82d9-42d0-ba93-1ee6242b289d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:47.597464 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e6dc1e63-82d9-42d0-ba93-1ee6242b289d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:47.601254 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:47.605365 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e6dc1e63-82d9-42d0-ba93-1ee6242b289d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:47.605813 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e6dc1e63-82d9-42d0-ba93-1ee6242b289d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:47.606583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e6dc1e63-82d9-42d0-ba93-1ee6242b289d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:47.607051 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e6dc1e63-82d9-42d0-ba93-1ee6242b289d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:47.755889 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e6dc1e63-82d9-42d0-ba93-1ee6242b289d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:47.763939 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e6dc1e63-82d9-42d0-ba93-1ee6242b289d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.170371 Jun 23 16:03:47.764534 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 193/395] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:47 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:47.994564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a04f3286-ff58-4fb0-871e-b0ed80025cd9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:47.995140 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a04f3286-ff58-4fb0-871e-b0ed80025cd9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:48.001794 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a04f3286-ff58-4fb0-871e-b0ed80025cd9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:48.002439 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a04f3286-ff58-4fb0-871e-b0ed80025cd9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:48.003311 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a04f3286-ff58-4fb0-871e-b0ed80025cd9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:48.003739 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a04f3286-ff58-4fb0-871e-b0ed80025cd9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:48.137658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a04f3286-ff58-4fb0-871e-b0ed80025cd9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:48.145663 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a04f3286-ff58-4fb0-871e-b0ed80025cd9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.155756 Jun 23 16:03:48.146423 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 203/396] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:47 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:48.784002 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-58d3e260-21ac-4ee7-92fa-c0540e8bc612 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:48.784878 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-58d3e260-21ac-4ee7-92fa-c0540e8bc612 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:48.791776 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-58d3e260-21ac-4ee7-92fa-c0540e8bc612 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:48.792241 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-58d3e260-21ac-4ee7-92fa-c0540e8bc612 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:48.793007 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-58d3e260-21ac-4ee7-92fa-c0540e8bc612 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:48.793468 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-58d3e260-21ac-4ee7-92fa-c0540e8bc612 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:48.816783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:48.934757 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-58d3e260-21ac-4ee7-92fa-c0540e8bc612 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:48.943104 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-58d3e260-21ac-4ee7-92fa-c0540e8bc612 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.165365 Jun 23 16:03:48.944052 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 194/397] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:48 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:49.163139 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-aba8a7e4-7807-4abc-85f2-4f061651c285 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:49.163914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-aba8a7e4-7807-4abc-85f2-4f061651c285 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:49.171195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aba8a7e4-7807-4abc-85f2-4f061651c285 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:49.171648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aba8a7e4-7807-4abc-85f2-4f061651c285 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:49.172420 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aba8a7e4-7807-4abc-85f2-4f061651c285 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:49.172858 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aba8a7e4-7807-4abc-85f2-4f061651c285 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:49.315177 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-aba8a7e4-7807-4abc-85f2-4f061651c285 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:49.322787 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-aba8a7e4-7807-4abc-85f2-4f061651c285 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.163516 Jun 23 16:03:49.323352 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 204/398] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:49 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:49.969538 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-96334298-42b7-469e-90a4-284fb128f83d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:49.970135 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-96334298-42b7-469e-90a4-284fb128f83d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:49.976804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96334298-42b7-469e-90a4-284fb128f83d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:49.977236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96334298-42b7-469e-90a4-284fb128f83d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:49.977990 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96334298-42b7-469e-90a4-284fb128f83d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:49.978416 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96334298-42b7-469e-90a4-284fb128f83d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:50.113939 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-96334298-42b7-469e-90a4-284fb128f83d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:50.121763 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-96334298-42b7-469e-90a4-284fb128f83d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.157092 Jun 23 16:03:50.122313 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 195/399] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:49 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:50.339035 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7b749d0d-6e71-479a-a392-6121cd5d08f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:50.339653 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7b749d0d-6e71-479a-a392-6121cd5d08f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:50.346174 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7b749d0d-6e71-479a-a392-6121cd5d08f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:50.346623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7b749d0d-6e71-479a-a392-6121cd5d08f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:50.347416 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7b749d0d-6e71-479a-a392-6121cd5d08f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:50.347851 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7b749d0d-6e71-479a-a392-6121cd5d08f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:50.482670 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7b749d0d-6e71-479a-a392-6121cd5d08f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:50.491395 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7b749d0d-6e71-479a-a392-6121cd5d08f9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.156277 Jun 23 16:03:50.492949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 205/400] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:50 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:03:51.139004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7852cc23-491b-487a-bf67-b271a52edb67 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:51.139617 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7852cc23-491b-487a-bf67-b271a52edb67 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:51.145638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7852cc23-491b-487a-bf67-b271a52edb67 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:51.146078 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7852cc23-491b-487a-bf67-b271a52edb67 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:51.146866 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7852cc23-491b-487a-bf67-b271a52edb67 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:51.147303 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7852cc23-491b-487a-bf67-b271a52edb67 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:51.275031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7852cc23-491b-487a-bf67-b271a52edb67 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:51.282519 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7852cc23-491b-487a-bf67-b271a52edb67 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.147350 Jun 23 16:03:51.283117 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 196/401] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:51 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:51.509813 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6938cb15-1e84-4600-a1e1-40432e730df1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:51.510416 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6938cb15-1e84-4600-a1e1-40432e730df1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:51.516890 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6938cb15-1e84-4600-a1e1-40432e730df1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:51.517420 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6938cb15-1e84-4600-a1e1-40432e730df1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:51.518083 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6938cb15-1e84-4600-a1e1-40432e730df1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:51.518512 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6938cb15-1e84-4600-a1e1-40432e730df1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:51.647182 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6938cb15-1e84-4600-a1e1-40432e730df1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:51.655402 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6938cb15-1e84-4600-a1e1-40432e730df1 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.150264 Jun 23 16:03:51.655969 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 206/402] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:51 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:52.299868 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2ce45aef-41d6-4b0b-86a1-a0c0c1038ed4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:52.300385 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2ce45aef-41d6-4b0b-86a1-a0c0c1038ed4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:52.302214 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:03:52.308038 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2ce45aef-41d6-4b0b-86a1-a0c0c1038ed4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:52.308481 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2ce45aef-41d6-4b0b-86a1-a0c0c1038ed4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:52.309241 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2ce45aef-41d6-4b0b-86a1-a0c0c1038ed4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:52.309672 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2ce45aef-41d6-4b0b-86a1-a0c0c1038ed4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:52.442566 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2ce45aef-41d6-4b0b-86a1-a0c0c1038ed4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:52.450577 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2ce45aef-41d6-4b0b-86a1-a0c0c1038ed4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.154604 Jun 23 16:03:52.451168 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 197/403] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:52 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:52.672977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2b4f340a-849f-4b0f-9e55-f8f8b89f8545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:52.673586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2b4f340a-849f-4b0f-9e55-f8f8b89f8545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:52.680550 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b4f340a-849f-4b0f-9e55-f8f8b89f8545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:52.680996 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b4f340a-849f-4b0f-9e55-f8f8b89f8545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:52.681759 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b4f340a-849f-4b0f-9e55-f8f8b89f8545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:52.682190 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2b4f340a-849f-4b0f-9e55-f8f8b89f8545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:52.813074 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2b4f340a-849f-4b0f-9e55-f8f8b89f8545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:52.820977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2b4f340a-849f-4b0f-9e55-f8f8b89f8545 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.151835 Jun 23 16:03:52.821530 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 207/404] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:52 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:53.467966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-090df41f-1bb7-457b-804e-0891a32594f8 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:53.468575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-090df41f-1bb7-457b-804e-0891a32594f8 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:53.474531 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-090df41f-1bb7-457b-804e-0891a32594f8 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:53.475001 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-090df41f-1bb7-457b-804e-0891a32594f8 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:53.475744 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-090df41f-1bb7-457b-804e-0891a32594f8 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:53.476689 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-090df41f-1bb7-457b-804e-0891a32594f8 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:53.610726 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-090df41f-1bb7-457b-804e-0891a32594f8 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:53.618771 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-090df41f-1bb7-457b-804e-0891a32594f8 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.154617 Jun 23 16:03:53.619333 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 198/405] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:53 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:53.837437 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d770033e-fd09-4a7d-8143-2020912847e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:53.838045 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d770033e-fd09-4a7d-8143-2020912847e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:53.845099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d770033e-fd09-4a7d-8143-2020912847e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:53.845542 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d770033e-fd09-4a7d-8143-2020912847e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:53.846315 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d770033e-fd09-4a7d-8143-2020912847e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:53.846770 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d770033e-fd09-4a7d-8143-2020912847e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:53.979165 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d770033e-fd09-4a7d-8143-2020912847e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:53.995049 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d770033e-fd09-4a7d-8143-2020912847e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.161438 Jun 23 16:03:53.995635 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 208/406] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:53 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:54.636606 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-877155a8-0782-4eba-b771-0449a7cfbfe3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:54.637518 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-877155a8-0782-4eba-b771-0449a7cfbfe3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:54.644286 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-877155a8-0782-4eba-b771-0449a7cfbfe3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:54.644770 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-877155a8-0782-4eba-b771-0449a7cfbfe3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:54.645535 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-877155a8-0782-4eba-b771-0449a7cfbfe3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:54.645987 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-877155a8-0782-4eba-b771-0449a7cfbfe3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:54.780369 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-877155a8-0782-4eba-b771-0449a7cfbfe3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:54.787769 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-877155a8-0782-4eba-b771-0449a7cfbfe3 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.155847 Jun 23 16:03:54.788334 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 199/407] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:54 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:55.012966 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0a89dc33-eefc-4924-871b-21ab38058085 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:55.013585 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0a89dc33-eefc-4924-871b-21ab38058085 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:55.020621 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0a89dc33-eefc-4924-871b-21ab38058085 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:55.021075 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0a89dc33-eefc-4924-871b-21ab38058085 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:55.021901 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0a89dc33-eefc-4924-871b-21ab38058085 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:55.022339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0a89dc33-eefc-4924-871b-21ab38058085 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:55.157252 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0a89dc33-eefc-4924-871b-21ab38058085 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:55.164863 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0a89dc33-eefc-4924-871b-21ab38058085 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.156449 Jun 23 16:03:55.165433 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 209/408] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:55 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:55.805238 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-54c4d671-5dbd-4851-a065-67fc74688cb4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:55.805842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-54c4d671-5dbd-4851-a065-67fc74688cb4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:55.812161 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-54c4d671-5dbd-4851-a065-67fc74688cb4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:55.812534 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-54c4d671-5dbd-4851-a065-67fc74688cb4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:55.813374 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-54c4d671-5dbd-4851-a065-67fc74688cb4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:55.813850 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-54c4d671-5dbd-4851-a065-67fc74688cb4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:55.944126 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-54c4d671-5dbd-4851-a065-67fc74688cb4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:55.951680 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-54c4d671-5dbd-4851-a065-67fc74688cb4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.150563 Jun 23 16:03:55.952233 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 200/409] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:55 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:56.181686 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-82778365-ba4f-49c2-9b9d-c2624f7b9005 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:56.182281 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-82778365-ba4f-49c2-9b9d-c2624f7b9005 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:56.188684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82778365-ba4f-49c2-9b9d-c2624f7b9005 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:56.189134 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82778365-ba4f-49c2-9b9d-c2624f7b9005 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:56.189905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82778365-ba4f-49c2-9b9d-c2624f7b9005 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:56.190341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82778365-ba4f-49c2-9b9d-c2624f7b9005 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:56.330712 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-82778365-ba4f-49c2-9b9d-c2624f7b9005 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:56.339128 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-82778365-ba4f-49c2-9b9d-c2624f7b9005 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.161245 Jun 23 16:03:56.339707 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 210/410] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:56 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:56.967896 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-40063df5-dd8f-4c30-b978-34a148608376 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:56.968495 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-40063df5-dd8f-4c30-b978-34a148608376 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:56.974493 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40063df5-dd8f-4c30-b978-34a148608376 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:56.974976 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40063df5-dd8f-4c30-b978-34a148608376 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:56.975745 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40063df5-dd8f-4c30-b978-34a148608376 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:56.976189 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40063df5-dd8f-4c30-b978-34a148608376 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:57.107492 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-40063df5-dd8f-4c30-b978-34a148608376 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:57.114958 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-40063df5-dd8f-4c30-b978-34a148608376 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.150872 Jun 23 16:03:57.115532 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 201/411] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:56 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:57.356756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b7bb218c-4540-4127-9c26-c807e4efe147 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:57.357406 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b7bb218c-4540-4127-9c26-c807e4efe147 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:57.364860 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7bb218c-4540-4127-9c26-c807e4efe147 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:57.365314 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7bb218c-4540-4127-9c26-c807e4efe147 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:57.366091 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7bb218c-4540-4127-9c26-c807e4efe147 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:57.366531 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b7bb218c-4540-4127-9c26-c807e4efe147 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:57.501211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b7bb218c-4540-4127-9c26-c807e4efe147 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:57.508754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b7bb218c-4540-4127-9c26-c807e4efe147 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.155882 Jun 23 16:03:57.509329 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 211/412] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:57 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:58.132330 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-04051d58-09fa-400a-9721-4ec9cea0b46f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:58.132910 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-04051d58-09fa-400a-9721-4ec9cea0b46f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:58.138982 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-04051d58-09fa-400a-9721-4ec9cea0b46f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:58.139432 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-04051d58-09fa-400a-9721-4ec9cea0b46f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:58.140194 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-04051d58-09fa-400a-9721-4ec9cea0b46f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:58.140626 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-04051d58-09fa-400a-9721-4ec9cea0b46f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:58.269250 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-04051d58-09fa-400a-9721-4ec9cea0b46f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:58.277316 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-04051d58-09fa-400a-9721-4ec9cea0b46f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.148929 Jun 23 16:03:58.277870 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 202/413] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:58 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:58.526620 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7df3eae3-eb67-4d07-a7c8-a46fa00648e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:58.527445 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7df3eae3-eb67-4d07-a7c8-a46fa00648e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:58.534020 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7df3eae3-eb67-4d07-a7c8-a46fa00648e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:58.534466 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7df3eae3-eb67-4d07-a7c8-a46fa00648e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:58.535263 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7df3eae3-eb67-4d07-a7c8-a46fa00648e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:58.535698 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7df3eae3-eb67-4d07-a7c8-a46fa00648e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:58.673194 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7df3eae3-eb67-4d07-a7c8-a46fa00648e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:58.680984 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7df3eae3-eb67-4d07-a7c8-a46fa00648e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.159152 Jun 23 16:03:58.681551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 212/414] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:58 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:59.293801 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9185f5ce-4ea3-473e-85b8-e02e7ba79808 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:59.294529 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9185f5ce-4ea3-473e-85b8-e02e7ba79808 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:59.301132 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9185f5ce-4ea3-473e-85b8-e02e7ba79808 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:59.301579 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9185f5ce-4ea3-473e-85b8-e02e7ba79808 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:59.302351 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9185f5ce-4ea3-473e-85b8-e02e7ba79808 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:59.302865 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9185f5ce-4ea3-473e-85b8-e02e7ba79808 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:59.698624 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-84167a64-f40b-4267-ad5a-1f25698d94fc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:03:59.700572 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-84167a64-f40b-4267-ad5a-1f25698d94fc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:03:59.704201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9185f5ce-4ea3-473e-85b8-e02e7ba79808 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:59.729988 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84167a64-f40b-4267-ad5a-1f25698d94fc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:59.731809 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9185f5ce-4ea3-473e-85b8-e02e7ba79808 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.435802 Jun 23 16:03:59.738773 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 203/415] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:59 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:03:59.739195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84167a64-f40b-4267-ad5a-1f25698d94fc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:59.739195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84167a64-f40b-4267-ad5a-1f25698d94fc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:03:59.739195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-84167a64-f40b-4267-ad5a-1f25698d94fc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:03:59.897053 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-84167a64-f40b-4267-ad5a-1f25698d94fc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:03:59.905059 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-84167a64-f40b-4267-ad5a-1f25698d94fc tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.211466 Jun 23 16:03:59.905646 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 213/416] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:03:59 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:00.748907 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ab09112b-5a92-4e55-a625-8c07a7d7b836 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:00.749516 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ab09112b-5a92-4e55-a625-8c07a7d7b836 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:00.755615 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ab09112b-5a92-4e55-a625-8c07a7d7b836 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:00.756068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ab09112b-5a92-4e55-a625-8c07a7d7b836 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:00.756823 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ab09112b-5a92-4e55-a625-8c07a7d7b836 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:00.757259 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ab09112b-5a92-4e55-a625-8c07a7d7b836 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:00.892543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ab09112b-5a92-4e55-a625-8c07a7d7b836 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:00.900337 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ab09112b-5a92-4e55-a625-8c07a7d7b836 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.154977 Jun 23 16:04:00.900908 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 204/417] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:00 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:04:00.921769 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4fd7acb1-d2f1-40bf-b938-4dc9787fb83b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:00.922359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4fd7acb1-d2f1-40bf-b938-4dc9787fb83b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:00.929197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4fd7acb1-d2f1-40bf-b938-4dc9787fb83b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:00.930004 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4fd7acb1-d2f1-40bf-b938-4dc9787fb83b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:00.931564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4fd7acb1-d2f1-40bf-b938-4dc9787fb83b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:00.932007 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4fd7acb1-d2f1-40bf-b938-4dc9787fb83b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:01.087295 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4fd7acb1-d2f1-40bf-b938-4dc9787fb83b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:01.095463 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4fd7acb1-d2f1-40bf-b938-4dc9787fb83b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.177528 Jun 23 16:04:01.106556 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 214/418] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:00 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:01.117715 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-5fdfcea8-6d3b-4439-b6bf-7c8177b15e0f req-f3f97e5f-bcf7-4b33-a295-fe8d3b7bcadd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f780c86-8efc-4e87-be01-8cc68d03e036", "name": "network-vif-plugged", "status": "completed", "tag": "d0385da0-a330-4afb-a25d-690b7056b15d"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:04:01.126659 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-5fdfcea8-6d3b-4439-b6bf-7c8177b15e0f req-f3f97e5f-bcf7-4b33-a295-fe8d3b7bcadd service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:01.127200 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-5fdfcea8-6d3b-4439-b6bf-7c8177b15e0f req-f3f97e5f-bcf7-4b33-a295-fe8d3b7bcadd service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:01.141955 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-5fdfcea8-6d3b-4439-b6bf-7c8177b15e0f req-f3f97e5f-bcf7-4b33-a295-fe8d3b7bcadd service nova] Creating event network-vif-plugged:d0385da0-a330-4afb-a25d-690b7056b15d for instance 8f780c86-8efc-4e87-be01-8cc68d03e036 on hv-cinder-83538 Jun 23 16:04:01.147695 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-5fdfcea8-6d3b-4439-b6bf-7c8177b15e0f req-f3f97e5f-bcf7-4b33-a295-fe8d3b7bcadd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033168 Jun 23 16:04:01.148627 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 205/419] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:04:01.918174 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-058bdfa4-5605-40f5-8ac9-39aab7df0ddd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:01.919119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-058bdfa4-5605-40f5-8ac9-39aab7df0ddd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:01.930047 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-058bdfa4-5605-40f5-8ac9-39aab7df0ddd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:01.931564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-058bdfa4-5605-40f5-8ac9-39aab7df0ddd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:01.932466 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-058bdfa4-5605-40f5-8ac9-39aab7df0ddd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:01.933010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-058bdfa4-5605-40f5-8ac9-39aab7df0ddd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:01.948987 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:02.087234 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-058bdfa4-5605-40f5-8ac9-39aab7df0ddd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:02.094564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-058bdfa4-5605-40f5-8ac9-39aab7df0ddd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.180990 Jun 23 16:04:02.095234 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 215/420] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:01 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:02.113769 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b5c64c1b-6712-49ea-9f1f-298495a74f49 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:02.114448 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b5c64c1b-6712-49ea-9f1f-298495a74f49 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:02.121268 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b5c64c1b-6712-49ea-9f1f-298495a74f49 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:02.121713 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b5c64c1b-6712-49ea-9f1f-298495a74f49 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:02.122465 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b5c64c1b-6712-49ea-9f1f-298495a74f49 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:02.122986 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b5c64c1b-6712-49ea-9f1f-298495a74f49 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:02.261437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b5c64c1b-6712-49ea-9f1f-298495a74f49 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:02.268889 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b5c64c1b-6712-49ea-9f1f-298495a74f49 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.159166 Jun 23 16:04:02.269483 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 206/421] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:02 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:03.112145 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4fdf2b6a-9cbe-442d-a181-dafb41d78c8b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:03.112898 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4fdf2b6a-9cbe-442d-a181-dafb41d78c8b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:03.122848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4fdf2b6a-9cbe-442d-a181-dafb41d78c8b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:03.123709 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4fdf2b6a-9cbe-442d-a181-dafb41d78c8b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:03.124772 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4fdf2b6a-9cbe-442d-a181-dafb41d78c8b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:03.125369 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4fdf2b6a-9cbe-442d-a181-dafb41d78c8b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:03.286889 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-52dd758e-3b0b-4d82-b53e-134c67431eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:03.288486 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-52dd758e-3b0b-4d82-b53e-134c67431eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:03.295842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-52dd758e-3b0b-4d82-b53e-134c67431eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:03.297060 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-52dd758e-3b0b-4d82-b53e-134c67431eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:03.298413 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-52dd758e-3b0b-4d82-b53e-134c67431eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:03.299360 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-52dd758e-3b0b-4d82-b53e-134c67431eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:03.302773 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4fdf2b6a-9cbe-442d-a181-dafb41d78c8b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:03.312702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4fdf2b6a-9cbe-442d-a181-dafb41d78c8b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.204478 Jun 23 16:04:03.313616 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 216/422] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:03 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:03.443690 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-52dd758e-3b0b-4d82-b53e-134c67431eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:03.452458 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-52dd758e-3b0b-4d82-b53e-134c67431eca tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.170799 Jun 23 16:04:03.462034 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 207/423] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:03 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:04.329500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-10667803-f250-4a91-aa32-fc75e6ef90ca tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:04.330074 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-10667803-f250-4a91-aa32-fc75e6ef90ca tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:04.339012 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-10667803-f250-4a91-aa32-fc75e6ef90ca tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:04.340099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-10667803-f250-4a91-aa32-fc75e6ef90ca tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:04.342498 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-10667803-f250-4a91-aa32-fc75e6ef90ca tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:04.343382 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-10667803-f250-4a91-aa32-fc75e6ef90ca tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:04.470151 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b439bcb1-9df2-4762-b932-6b43d7d83be8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:04.471454 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b439bcb1-9df2-4762-b932-6b43d7d83be8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:04.477374 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b439bcb1-9df2-4762-b932-6b43d7d83be8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:04.478055 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b439bcb1-9df2-4762-b932-6b43d7d83be8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:04.479479 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b439bcb1-9df2-4762-b932-6b43d7d83be8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:04.480249 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b439bcb1-9df2-4762-b932-6b43d7d83be8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:04.500997 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-10667803-f250-4a91-aa32-fc75e6ef90ca tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:04.509478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-10667803-f250-4a91-aa32-fc75e6ef90ca tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.184211 Jun 23 16:04:04.520855 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 217/424] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:04 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:04.659606 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b439bcb1-9df2-4762-b932-6b43d7d83be8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:04.667634 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b439bcb1-9df2-4762-b932-6b43d7d83be8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.201921 Jun 23 16:04:04.668306 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 208/425] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:04 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:05.530491 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c4f272cd-2b26-4c19-8323-ffa3d63aa894 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:05.531312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c4f272cd-2b26-4c19-8323-ffa3d63aa894 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:05.542290 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4f272cd-2b26-4c19-8323-ffa3d63aa894 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:05.542947 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4f272cd-2b26-4c19-8323-ffa3d63aa894 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:05.543969 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4f272cd-2b26-4c19-8323-ffa3d63aa894 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:05.544871 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4f272cd-2b26-4c19-8323-ffa3d63aa894 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:05.688665 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e1e63bba-a618-4118-a184-084a21711a2a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:05.692055 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e1e63bba-a618-4118-a184-084a21711a2a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:05.706562 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e1e63bba-a618-4118-a184-084a21711a2a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:05.708084 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e1e63bba-a618-4118-a184-084a21711a2a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:05.708673 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c4f272cd-2b26-4c19-8323-ffa3d63aa894 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:05.710848 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e1e63bba-a618-4118-a184-084a21711a2a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:05.712912 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e1e63bba-a618-4118-a184-084a21711a2a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:05.719206 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c4f272cd-2b26-4c19-8323-ffa3d63aa894 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.196872 Jun 23 16:04:05.720170 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 218/426] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:05 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:05.887466 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e1e63bba-a618-4118-a184-084a21711a2a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:05.896172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e1e63bba-a618-4118-a184-084a21711a2a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.214017 Jun 23 16:04:05.896735 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 209/427] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:05 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:06.737290 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a36b0a98-d402-4e70-8147-09b5dc0b6d4b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:06.737872 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a36b0a98-d402-4e70-8147-09b5dc0b6d4b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:06.749816 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a36b0a98-d402-4e70-8147-09b5dc0b6d4b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:06.750611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a36b0a98-d402-4e70-8147-09b5dc0b6d4b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:06.752022 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a36b0a98-d402-4e70-8147-09b5dc0b6d4b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:06.753059 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a36b0a98-d402-4e70-8147-09b5dc0b6d4b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:06.918877 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3f9a8b2f-122b-4746-8f97-f62ffca56e79 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:06.919780 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3f9a8b2f-122b-4746-8f97-f62ffca56e79 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:06.937942 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f9a8b2f-122b-4746-8f97-f62ffca56e79 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:06.938856 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f9a8b2f-122b-4746-8f97-f62ffca56e79 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:06.940056 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f9a8b2f-122b-4746-8f97-f62ffca56e79 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:06.940744 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f9a8b2f-122b-4746-8f97-f62ffca56e79 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:06.954918 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a36b0a98-d402-4e70-8147-09b5dc0b6d4b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:06.968363 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a36b0a98-d402-4e70-8147-09b5dc0b6d4b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.235031 Jun 23 16:04:06.969365 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 219/428] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:06 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:07.161277 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3f9a8b2f-122b-4746-8f97-f62ffca56e79 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:07.170928 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3f9a8b2f-122b-4746-8f97-f62ffca56e79 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.257583 Jun 23 16:04:07.179824 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 210/429] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:06 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:04:07.985642 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fd749914-c565-477f-9699-129a481b877b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:07.986241 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fd749914-c565-477f-9699-129a481b877b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:07.994128 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd749914-c565-477f-9699-129a481b877b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:07.994580 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd749914-c565-477f-9699-129a481b877b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:07.995382 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd749914-c565-477f-9699-129a481b877b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:07.995818 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd749914-c565-477f-9699-129a481b877b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:08.146444 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fd749914-c565-477f-9699-129a481b877b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:08.157111 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fd749914-c565-477f-9699-129a481b877b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.175434 Jun 23 16:04:08.170284 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 220/430] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:07 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:08.189558 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4f2e683b-73aa-447f-850a-b4174b936a52 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:08.190171 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4f2e683b-73aa-447f-850a-b4174b936a52 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:08.200618 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f2e683b-73aa-447f-850a-b4174b936a52 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:08.201067 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f2e683b-73aa-447f-850a-b4174b936a52 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:08.201848 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f2e683b-73aa-447f-850a-b4174b936a52 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:08.202283 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f2e683b-73aa-447f-850a-b4174b936a52 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:08.393758 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4f2e683b-73aa-447f-850a-b4174b936a52 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:08.403639 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:08.423893 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4f2e683b-73aa-447f-850a-b4174b936a52 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.238755 Jun 23 16:04:08.435130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 211/431] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:08 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:09.176403 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a484701f-88e3-45ff-9975-212fc9868ac7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:09.177034 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a484701f-88e3-45ff-9975-212fc9868ac7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:09.181039 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=58 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:09.190504 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a484701f-88e3-45ff-9975-212fc9868ac7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:09.191114 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a484701f-88e3-45ff-9975-212fc9868ac7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:09.192191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a484701f-88e3-45ff-9975-212fc9868ac7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:09.192744 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a484701f-88e3-45ff-9975-212fc9868ac7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:09.373478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a484701f-88e3-45ff-9975-212fc9868ac7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:09.384467 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a484701f-88e3-45ff-9975-212fc9868ac7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.212176 Jun 23 16:04:09.385418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 221/432] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:09 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:09.444778 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-89770db3-239f-4dce-81a4-f6f9f4270cd7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:09.446457 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-89770db3-239f-4dce-81a4-f6f9f4270cd7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:09.458017 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89770db3-239f-4dce-81a4-f6f9f4270cd7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:09.458738 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89770db3-239f-4dce-81a4-f6f9f4270cd7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:09.461082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89770db3-239f-4dce-81a4-f6f9f4270cd7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:09.462379 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-89770db3-239f-4dce-81a4-f6f9f4270cd7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:09.639266 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-89770db3-239f-4dce-81a4-f6f9f4270cd7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:09.648080 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-89770db3-239f-4dce-81a4-f6f9f4270cd7 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.207260 Jun 23 16:04:09.648668 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 212/433] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:09 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:10.403893 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8d94c9e9-40bd-478f-8abd-159d35148e0e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:10.405230 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8d94c9e9-40bd-478f-8abd-159d35148e0e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:10.417153 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d94c9e9-40bd-478f-8abd-159d35148e0e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:10.417604 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d94c9e9-40bd-478f-8abd-159d35148e0e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:10.418392 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d94c9e9-40bd-478f-8abd-159d35148e0e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:10.418858 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d94c9e9-40bd-478f-8abd-159d35148e0e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:10.556657 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-b91ccc28-07d2-45cc-8322-714700c60f7d req-9a9bbe8f-d0c8-4474-8160-3b32c94c74a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "649b033e-63c2-44c2-a597-4192007bb977", "name": "network-vif-plugged", "status": "completed", "tag": "c631e37e-f39c-4dd5-871a-90b0efe598ae"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:04:10.583094 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b91ccc28-07d2-45cc-8322-714700c60f7d req-9a9bbe8f-d0c8-4474-8160-3b32c94c74a0 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:10.585581 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b91ccc28-07d2-45cc-8322-714700c60f7d req-9a9bbe8f-d0c8-4474-8160-3b32c94c74a0 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:10.624662 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-b91ccc28-07d2-45cc-8322-714700c60f7d req-9a9bbe8f-d0c8-4474-8160-3b32c94c74a0 service nova] Creating event network-vif-plugged:c631e37e-f39c-4dd5-871a-90b0efe598ae for instance 649b033e-63c2-44c2-a597-4192007bb977 on hv-cinder-83538 Jun 23 16:04:10.644333 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-b91ccc28-07d2-45cc-8322-714700c60f7d req-9a9bbe8f-d0c8-4474-8160-3b32c94c74a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092197 Jun 23 16:04:10.645385 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 213/434] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:04:10.667622 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-84969e9a-e283-4c4e-a561-baec12576def tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:10.668551 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-84969e9a-e283-4c4e-a561-baec12576def tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:10.673614 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8d94c9e9-40bd-478f-8abd-159d35148e0e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:10.676848 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84969e9a-e283-4c4e-a561-baec12576def tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:10.677349 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84969e9a-e283-4c4e-a561-baec12576def tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:10.678346 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84969e9a-e283-4c4e-a561-baec12576def tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:10.679231 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84969e9a-e283-4c4e-a561-baec12576def tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:10.706415 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8d94c9e9-40bd-478f-8abd-159d35148e0e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1363 microversion: 2.1 time: 0.306600 Jun 23 16:04:10.707038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 222/435] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:10 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:10.867233 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-84969e9a-e283-4c4e-a561-baec12576def tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:10.874956 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-84969e9a-e283-4c4e-a561-baec12576def tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.212745 Jun 23 16:04:10.875535 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 214/436] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:10 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:04:11.723526 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-92b83b81-610e-46de-933b-e321929a9a01 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:11.724767 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-92b83b81-610e-46de-933b-e321929a9a01 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:11.733604 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-92b83b81-610e-46de-933b-e321929a9a01 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:11.734079 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-92b83b81-610e-46de-933b-e321929a9a01 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:11.734912 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-92b83b81-610e-46de-933b-e321929a9a01 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:11.735377 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-92b83b81-610e-46de-933b-e321929a9a01 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:11.893806 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-df69c121-3a09-46ff-9469-30ad57954b9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:11.894410 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-df69c121-3a09-46ff-9469-30ad57954b9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:11.901133 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df69c121-3a09-46ff-9469-30ad57954b9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:11.901605 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df69c121-3a09-46ff-9469-30ad57954b9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:11.902372 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df69c121-3a09-46ff-9469-30ad57954b9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:11.902826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-df69c121-3a09-46ff-9469-30ad57954b9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:11.903808 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-92b83b81-610e-46de-933b-e321929a9a01 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:11.911457 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-92b83b81-610e-46de-933b-e321929a9a01 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1549 microversion: 2.1 time: 0.191716 Jun 23 16:04:11.912122 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 223/437] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:11 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1549 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:11.936256 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7c0c86f9-505e-458c-a5c2-267057eab717 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:11.936737 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7c0c86f9-505e-458c-a5c2-267057eab717 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:11.943402 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c0c86f9-505e-458c-a5c2-267057eab717 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:11.943840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c0c86f9-505e-458c-a5c2-267057eab717 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:11.944603 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c0c86f9-505e-458c-a5c2-267057eab717 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:11.945029 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c0c86f9-505e-458c-a5c2-267057eab717 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:12.033998 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7c0c86f9-505e-458c-a5c2-267057eab717 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096339 Jun 23 16:04:12.075388 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 224/438] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 23 16:04:11 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:04:12.136709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-df69c121-3a09-46ff-9469-30ad57954b9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:12.146013 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-df69c121-3a09-46ff-9469-30ad57954b9d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.256639 Jun 23 16:04:12.146928 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 215/439] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:11 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:04:12.855800 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-944373525", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-483265151", "security_groups": [{"name": "tempest-secgroup-smoke-760579093"}], "networks": [{"uuid": "9c31fde8-a2e0-4728-8be6-e78b6ca059b6"}], "block_device_mapping_v2": [{"uuid": "16a4153f-bcb3-49e6-a4e9-609f89f82167", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:04:13.077015 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] validate_networks() for [('9c31fde8-a2e0-4728-8be6-e78b6ca059b6', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:04:13.164233 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-866a3461-cfcf-4c73-b0bf-b9c4f7d38dc3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:13.164957 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-866a3461-cfcf-4c73-b0bf-b9c4f7d38dc3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:13.175877 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-866a3461-cfcf-4c73-b0bf-b9c4f7d38dc3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:13.176749 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-866a3461-cfcf-4c73-b0bf-b9c4f7d38dc3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:13.177788 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-866a3461-cfcf-4c73-b0bf-b9c4f7d38dc3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:13.178231 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-866a3461-cfcf-4c73-b0bf-b9c4f7d38dc3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:13.364976 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-866a3461-cfcf-4c73-b0bf-b9c4f7d38dc3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:13.378254 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-866a3461-cfcf-4c73-b0bf-b9c4f7d38dc3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 0.216908 Jun 23 16:04:13.380443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 216/440] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:13 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:04:13.843383 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-dcda386a-6b1e-40c3-997e-b8cc4f4eec6f req-b9abdeaf-931a-4a7d-bc96-43788923573b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f780c86-8efc-4e87-be01-8cc68d03e036", "tag": "d0385da0-a330-4afb-a25d-690b7056b15d"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:04:13.852779 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-dcda386a-6b1e-40c3-997e-b8cc4f4eec6f req-b9abdeaf-931a-4a7d-bc96-43788923573b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:13.853240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-dcda386a-6b1e-40c3-997e-b8cc4f4eec6f req-b9abdeaf-931a-4a7d-bc96-43788923573b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:13.903441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-dcda386a-6b1e-40c3-997e-b8cc4f4eec6f req-b9abdeaf-931a-4a7d-bc96-43788923573b service nova] Creating event network-changed:d0385da0-a330-4afb-a25d-690b7056b15d for instance 8f780c86-8efc-4e87-be01-8cc68d03e036 on hv-cinder-83538 Jun 23 16:04:13.907722 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-dcda386a-6b1e-40c3-997e-b8cc4f4eec6f req-b9abdeaf-931a-4a7d-bc96-43788923573b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073151 Jun 23 16:04:13.908730 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 217/441] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:04:13.918557 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:04:13.919175 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:04:13.919652 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:04:13.920203 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:04:13.920740 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:04:13.933027 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:13.933579 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:13.934408 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:13.935062 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:13.960593 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Getting quotas for project bbde90b595244aef82fd4d52d4abfaa8. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:04:13.966112 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Getting quotas for user 2399b4fc64f74475bd8dc7b1634a2c2a and project bbde90b595244aef82fd4d52d4abfaa8. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:04:14.058043 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:04:14.062595 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='16a4153f-bcb3-49e6-a4e9-609f89f82167',volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:04:14.276401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-07aae12e-fa9a-4199-97b3-ce0660de810d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.425929 Jun 23 16:04:14.278118 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 225/442] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:04:12 2022] POST /compute/v2.1/servers => generated 405 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:04:14.290442 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0d466553-ffb6-494d-bf44-96aa9760ce2a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:14.291192 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0d466553-ffb6-494d-bf44-96aa9760ce2a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:14.400406 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8d197858-db1c-4c90-b76b-582acf4cabe2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:14.401947 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8d197858-db1c-4c90-b76b-582acf4cabe2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:14.420125 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0d466553-ffb6-494d-bf44-96aa9760ce2a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:14.429248 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0d466553-ffb6-494d-bf44-96aa9760ce2a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1087 microversion: 2.1 time: 0.144512 Jun 23 16:04:14.432366 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 218/443] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:14 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1087 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:04:14.438276 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d197858-db1c-4c90-b76b-582acf4cabe2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:14.440969 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d197858-db1c-4c90-b76b-582acf4cabe2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:14.443791 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d197858-db1c-4c90-b76b-582acf4cabe2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:14.444499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8d197858-db1c-4c90-b76b-582acf4cabe2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:15.449550 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f1b20795-9879-4f1f-93b8-becb74e9aa13 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:15.450434 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f1b20795-9879-4f1f-93b8-becb74e9aa13 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:15.462773 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1b20795-9879-4f1f-93b8-becb74e9aa13 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:15.463234 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1b20795-9879-4f1f-93b8-becb74e9aa13 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:15.466128 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1b20795-9879-4f1f-93b8-becb74e9aa13 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:15.471697 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f1b20795-9879-4f1f-93b8-becb74e9aa13 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:15.589206 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8d197858-db1c-4c90-b76b-582acf4cabe2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:15.614027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f1b20795-9879-4f1f-93b8-becb74e9aa13 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:15.615952 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8d197858-db1c-4c90-b76b-582acf4cabe2 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1370 microversion: 2.1 time: 1.223097 Jun 23 16:04:15.619015 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 226/444] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:14 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1370 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:15.633019 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f1b20795-9879-4f1f-93b8-becb74e9aa13 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1137 microversion: 2.1 time: 0.187793 Jun 23 16:04:15.636768 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 219/445] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:15 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1137 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:16.634558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8c3b6493-7bd7-4d83-85d0-21c00cfe845d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:16.636043 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8c3b6493-7bd7-4d83-85d0-21c00cfe845d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:16.643973 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c3b6493-7bd7-4d83-85d0-21c00cfe845d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:16.651725 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-907fd854-4548-4b18-9ea5-9ed95762063f tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:16.653596 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-907fd854-4548-4b18-9ea5-9ed95762063f tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:16.658522 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c3b6493-7bd7-4d83-85d0-21c00cfe845d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:16.661941 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c3b6493-7bd7-4d83-85d0-21c00cfe845d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:16.662575 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c3b6493-7bd7-4d83-85d0-21c00cfe845d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:16.670583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-907fd854-4548-4b18-9ea5-9ed95762063f tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:16.671291 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-907fd854-4548-4b18-9ea5-9ed95762063f tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:16.673025 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-907fd854-4548-4b18-9ea5-9ed95762063f tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:16.675017 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-907fd854-4548-4b18-9ea5-9ed95762063f tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:16.748833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-907fd854-4548-4b18-9ea5-9ed95762063f tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:16.768627 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-907fd854-4548-4b18-9ea5-9ed95762063f tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1203 microversion: 2.1 time: 0.122637 Jun 23 16:04:16.771403 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 220/446] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:16 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1203 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:04:16.856304 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8c3b6493-7bd7-4d83-85d0-21c00cfe845d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:16.863921 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8c3b6493-7bd7-4d83-85d0-21c00cfe845d tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1563 microversion: 2.1 time: 0.234307 Jun 23 16:04:16.864489 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 227/447] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:16 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1563 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:16.881024 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-11edb306-82ba-43c7-a395-054c3e5558e0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:16.881524 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-11edb306-82ba-43c7-a395-054c3e5558e0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:16.889782 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-11edb306-82ba-43c7-a395-054c3e5558e0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:16.890234 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-11edb306-82ba-43c7-a395-054c3e5558e0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:16.891042 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-11edb306-82ba-43c7-a395-054c3e5558e0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:16.891659 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-11edb306-82ba-43c7-a395-054c3e5558e0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:16.994681 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-11edb306-82ba-43c7-a395-054c3e5558e0 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117265 Jun 23 16:04:16.995656 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 221/448] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 23 16:04:16 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:04:17.787229 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8df013c9-5de4-47eb-9f7c-b280df6ee1f2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:17.792047 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8df013c9-5de4-47eb-9f7c-b280df6ee1f2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:17.845057 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8df013c9-5de4-47eb-9f7c-b280df6ee1f2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:17.847156 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8df013c9-5de4-47eb-9f7c-b280df6ee1f2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:17.849787 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8df013c9-5de4-47eb-9f7c-b280df6ee1f2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:17.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8df013c9-5de4-47eb-9f7c-b280df6ee1f2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:18.191851 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8df013c9-5de4-47eb-9f7c-b280df6ee1f2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:18.204781 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8df013c9-5de4-47eb-9f7c-b280df6ee1f2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.421329 Jun 23 16:04:18.205830 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 228/449] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:17 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:18.604283 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-a24b9ebd-c82f-4e13-b839-cc4b9fe1445b req-e7659144-62af-4097-8f48-8e166569ff6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d20925-62c2-42d3-9cd4-87cafcfcb78c", "tag": "a2b7418c-7a16-44c2-9376-785b79ce1926"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:04:18.616834 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-a24b9ebd-c82f-4e13-b839-cc4b9fe1445b req-e7659144-62af-4097-8f48-8e166569ff6d service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:18.619265 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-a24b9ebd-c82f-4e13-b839-cc4b9fe1445b req-e7659144-62af-4097-8f48-8e166569ff6d service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:18.638589 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-a24b9ebd-c82f-4e13-b839-cc4b9fe1445b req-e7659144-62af-4097-8f48-8e166569ff6d service nova] Creating event network-changed:a2b7418c-7a16-44c2-9376-785b79ce1926 for instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c on hv-cinder-83538 Jun 23 16:04:18.643803 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-a24b9ebd-c82f-4e13-b839-cc4b9fe1445b req-e7659144-62af-4097-8f48-8e166569ff6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043555 Jun 23 16:04:18.644414 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 222/450] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:04:18.967350 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-648eb64e-c381-4147-a4f9-2824dd1c40ff req-dda511b4-7963-45ee-a931-6229d5d17959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "649b033e-63c2-44c2-a597-4192007bb977", "tag": "c631e37e-f39c-4dd5-871a-90b0efe598ae"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:04:18.975941 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-648eb64e-c381-4147-a4f9-2824dd1c40ff req-dda511b4-7963-45ee-a931-6229d5d17959 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:18.976957 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-648eb64e-c381-4147-a4f9-2824dd1c40ff req-dda511b4-7963-45ee-a931-6229d5d17959 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:18.987867 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-648eb64e-c381-4147-a4f9-2824dd1c40ff req-dda511b4-7963-45ee-a931-6229d5d17959 service nova] Creating event network-changed:c631e37e-f39c-4dd5-871a-90b0efe598ae for instance 649b033e-63c2-44c2-a597-4192007bb977 on hv-cinder-83538 Jun 23 16:04:18.993496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-648eb64e-c381-4147-a4f9-2824dd1c40ff req-dda511b4-7963-45ee-a931-6229d5d17959 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029978 Jun 23 16:04:18.994096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 229/451] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:04:19.223278 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-49fc4f22-9020-4dae-9b39-bc34549d1d8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:19.223891 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-49fc4f22-9020-4dae-9b39-bc34549d1d8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:19.230562 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-49fc4f22-9020-4dae-9b39-bc34549d1d8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:19.231047 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-49fc4f22-9020-4dae-9b39-bc34549d1d8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:19.231813 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-49fc4f22-9020-4dae-9b39-bc34549d1d8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:19.232253 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-49fc4f22-9020-4dae-9b39-bc34549d1d8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:19.380103 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-49fc4f22-9020-4dae-9b39-bc34549d1d8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:19.390236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-49fc4f22-9020-4dae-9b39-bc34549d1d8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.171189 Jun 23 16:04:19.390908 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 223/452] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:19 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:20.408515 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fa079924-9cf4-4051-b69e-3b788f5a9638 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:20.409245 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fa079924-9cf4-4051-b69e-3b788f5a9638 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:20.416079 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fa079924-9cf4-4051-b69e-3b788f5a9638 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:20.416529 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fa079924-9cf4-4051-b69e-3b788f5a9638 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:20.417287 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fa079924-9cf4-4051-b69e-3b788f5a9638 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:20.417750 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fa079924-9cf4-4051-b69e-3b788f5a9638 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:20.551699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fa079924-9cf4-4051-b69e-3b788f5a9638 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:20.559532 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fa079924-9cf4-4051-b69e-3b788f5a9638 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.155560 Jun 23 16:04:20.560101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 230/453] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:20 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:21.577010 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dd189bba-2b34-41d5-9a05-8df52c1f984b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:21.577622 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dd189bba-2b34-41d5-9a05-8df52c1f984b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:21.583695 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dd189bba-2b34-41d5-9a05-8df52c1f984b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:21.584141 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dd189bba-2b34-41d5-9a05-8df52c1f984b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:21.584899 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dd189bba-2b34-41d5-9a05-8df52c1f984b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:21.585334 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dd189bba-2b34-41d5-9a05-8df52c1f984b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:21.716211 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dd189bba-2b34-41d5-9a05-8df52c1f984b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:21.723743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dd189bba-2b34-41d5-9a05-8df52c1f984b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.150887 Jun 23 16:04:21.724300 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 224/454] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:21 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:22.746154 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-705e5b50-a788-4708-ac57-0b0a6e86f3dc tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:22.746154 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-705e5b50-a788-4708-ac57-0b0a6e86f3dc tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:22.749063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-705e5b50-a788-4708-ac57-0b0a6e86f3dc tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:22.749507 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-705e5b50-a788-4708-ac57-0b0a6e86f3dc tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:22.750483 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-705e5b50-a788-4708-ac57-0b0a6e86f3dc tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:22.750944 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-705e5b50-a788-4708-ac57-0b0a6e86f3dc tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:23.006013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-705e5b50-a788-4708-ac57-0b0a6e86f3dc tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:23.016743 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-705e5b50-a788-4708-ac57-0b0a6e86f3dc tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.279499 Jun 23 16:04:23.028096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 231/455] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:22 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:24.034309 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ec7ab4d0-f1c8-4124-b070-c6566effaf8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:24.034966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ec7ab4d0-f1c8-4124-b070-c6566effaf8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:24.036916 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=58 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:24.042220 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ec7ab4d0-f1c8-4124-b070-c6566effaf8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:24.042743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ec7ab4d0-f1c8-4124-b070-c6566effaf8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:24.043507 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ec7ab4d0-f1c8-4124-b070-c6566effaf8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:24.043938 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ec7ab4d0-f1c8-4124-b070-c6566effaf8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:24.179204 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ec7ab4d0-f1c8-4124-b070-c6566effaf8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:24.186588 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ec7ab4d0-f1c8-4124-b070-c6566effaf8a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.156104 Jun 23 16:04:24.187184 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 225/456] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:24 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:25.203113 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9caa627c-5c8d-468e-9657-7635df1262b9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:25.203728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9caa627c-5c8d-468e-9657-7635df1262b9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:25.206190 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:25.206910 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=6 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:25.213304 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9caa627c-5c8d-468e-9657-7635df1262b9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:25.213756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9caa627c-5c8d-468e-9657-7635df1262b9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:25.214530 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9caa627c-5c8d-468e-9657-7635df1262b9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:25.215000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9caa627c-5c8d-468e-9657-7635df1262b9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:25.353936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9caa627c-5c8d-468e-9657-7635df1262b9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:25.361763 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9caa627c-5c8d-468e-9657-7635df1262b9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.162582 Jun 23 16:04:25.362350 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 232/457] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:25 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:26.378365 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-280e582f-30be-47a0-a2d8-a13ee4d2a51b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:26.379011 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-280e582f-30be-47a0-a2d8-a13ee4d2a51b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:26.381009 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:26.386164 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-280e582f-30be-47a0-a2d8-a13ee4d2a51b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:26.386627 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-280e582f-30be-47a0-a2d8-a13ee4d2a51b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:26.387429 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-280e582f-30be-47a0-a2d8-a13ee4d2a51b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:26.387859 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-280e582f-30be-47a0-a2d8-a13ee4d2a51b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:26.520055 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-280e582f-30be-47a0-a2d8-a13ee4d2a51b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:26.528228 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-280e582f-30be-47a0-a2d8-a13ee4d2a51b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.153824 Jun 23 16:04:26.528794 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 226/458] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:26 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:27.545462 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6f84edc6-5fd2-4280-bc65-555b88f4b34d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:27.546388 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6f84edc6-5fd2-4280-bc65-555b88f4b34d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:27.553709 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f84edc6-5fd2-4280-bc65-555b88f4b34d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:27.554174 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f84edc6-5fd2-4280-bc65-555b88f4b34d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:27.554997 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f84edc6-5fd2-4280-bc65-555b88f4b34d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:27.555432 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f84edc6-5fd2-4280-bc65-555b88f4b34d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:27.695955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6f84edc6-5fd2-4280-bc65-555b88f4b34d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:27.698185 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:27.704587 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6f84edc6-5fd2-4280-bc65-555b88f4b34d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.163618 Jun 23 16:04:27.705153 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 233/459] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:27 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:28.722977 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-03a32060-3f62-4267-8339-a3aa18afa101 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:28.724147 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-03a32060-3f62-4267-8339-a3aa18afa101 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:28.731516 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03a32060-3f62-4267-8339-a3aa18afa101 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:28.732645 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03a32060-3f62-4267-8339-a3aa18afa101 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:28.733655 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03a32060-3f62-4267-8339-a3aa18afa101 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:28.734408 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03a32060-3f62-4267-8339-a3aa18afa101 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:28.890725 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-03a32060-3f62-4267-8339-a3aa18afa101 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:28.899333 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-03a32060-3f62-4267-8339-a3aa18afa101 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.180400 Jun 23 16:04:28.900238 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 227/460] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:28 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:29.917275 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e9a3f98f-41db-46c1-b1a8-e4e1e4c4ac22 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:29.918019 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e9a3f98f-41db-46c1-b1a8-e4e1e4c4ac22 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:29.925052 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e9a3f98f-41db-46c1-b1a8-e4e1e4c4ac22 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:29.925835 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e9a3f98f-41db-46c1-b1a8-e4e1e4c4ac22 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:29.926684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e9a3f98f-41db-46c1-b1a8-e4e1e4c4ac22 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:29.927214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e9a3f98f-41db-46c1-b1a8-e4e1e4c4ac22 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:30.254001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e9a3f98f-41db-46c1-b1a8-e4e1e4c4ac22 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:30.262008 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e9a3f98f-41db-46c1-b1a8-e4e1e4c4ac22 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.349232 Jun 23 16:04:30.262950 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 234/461] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:29 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:04:31.279549 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-36e5e824-3aec-4301-9c9b-f1c0afee5149 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:31.280714 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-36e5e824-3aec-4301-9c9b-f1c0afee5149 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:31.287294 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-36e5e824-3aec-4301-9c9b-f1c0afee5149 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:31.287751 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-36e5e824-3aec-4301-9c9b-f1c0afee5149 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:31.288504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-36e5e824-3aec-4301-9c9b-f1c0afee5149 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:31.289034 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-36e5e824-3aec-4301-9c9b-f1c0afee5149 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:31.458900 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-36e5e824-3aec-4301-9c9b-f1c0afee5149 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:31.468455 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-36e5e824-3aec-4301-9c9b-f1c0afee5149 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.192588 Jun 23 16:04:31.469974 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 228/462] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:31 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:32.486214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-67e7f1de-29eb-415c-b56d-8a90d2599193 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:32.487027 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-67e7f1de-29eb-415c-b56d-8a90d2599193 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:32.494230 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-67e7f1de-29eb-415c-b56d-8a90d2599193 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:32.494683 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-67e7f1de-29eb-415c-b56d-8a90d2599193 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:32.495487 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-67e7f1de-29eb-415c-b56d-8a90d2599193 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:32.495925 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-67e7f1de-29eb-415c-b56d-8a90d2599193 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:32.694954 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-67e7f1de-29eb-415c-b56d-8a90d2599193 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:32.725890 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-67e7f1de-29eb-415c-b56d-8a90d2599193 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.243786 Jun 23 16:04:32.727371 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 235/463] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:32 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:33.743232 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1ee66a82-ffd7-4120-a5e6-decde56dd6af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:33.743887 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1ee66a82-ffd7-4120-a5e6-decde56dd6af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:33.750382 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ee66a82-ffd7-4120-a5e6-decde56dd6af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:33.750921 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ee66a82-ffd7-4120-a5e6-decde56dd6af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:33.751699 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ee66a82-ffd7-4120-a5e6-decde56dd6af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:33.752140 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1ee66a82-ffd7-4120-a5e6-decde56dd6af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:33.909680 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1ee66a82-ffd7-4120-a5e6-decde56dd6af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:33.917724 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1ee66a82-ffd7-4120-a5e6-decde56dd6af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.178363 Jun 23 16:04:33.918289 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 229/464] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:33 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:34.936203 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-677a6673-e9f5-41ba-8493-636de96b109e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:34.936914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-677a6673-e9f5-41ba-8493-636de96b109e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:34.944999 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-677a6673-e9f5-41ba-8493-636de96b109e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:34.945827 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-677a6673-e9f5-41ba-8493-636de96b109e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:34.946610 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-677a6673-e9f5-41ba-8493-636de96b109e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:34.947219 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-677a6673-e9f5-41ba-8493-636de96b109e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:35.136561 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-677a6673-e9f5-41ba-8493-636de96b109e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:35.154064 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-677a6673-e9f5-41ba-8493-636de96b109e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.222067 Jun 23 16:04:35.155107 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 236/465] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:34 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:36.172322 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-adff224e-6f36-4b69-bee0-163ac849a3f6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:36.172949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-adff224e-6f36-4b69-bee0-163ac849a3f6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:36.180386 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-adff224e-6f36-4b69-bee0-163ac849a3f6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:36.181080 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-adff224e-6f36-4b69-bee0-163ac849a3f6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:36.181859 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-adff224e-6f36-4b69-bee0-163ac849a3f6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:36.182602 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-adff224e-6f36-4b69-bee0-163ac849a3f6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:36.383339 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-adff224e-6f36-4b69-bee0-163ac849a3f6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:36.395498 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-adff224e-6f36-4b69-bee0-163ac849a3f6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.227057 Jun 23 16:04:36.406929 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 230/466] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:36 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:37.414144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d68b22ee-5655-4ac6-a305-1d7881b08e6c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:37.415599 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d68b22ee-5655-4ac6-a305-1d7881b08e6c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:37.425970 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d68b22ee-5655-4ac6-a305-1d7881b08e6c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:37.426442 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d68b22ee-5655-4ac6-a305-1d7881b08e6c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:37.427709 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d68b22ee-5655-4ac6-a305-1d7881b08e6c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:37.428308 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d68b22ee-5655-4ac6-a305-1d7881b08e6c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:37.621332 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d68b22ee-5655-4ac6-a305-1d7881b08e6c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:37.633259 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d68b22ee-5655-4ac6-a305-1d7881b08e6c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.223617 Jun 23 16:04:37.648252 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 237/467] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:37 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:38.651873 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d242e316-ae5a-41cc-8bb1-eb2df681324a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:38.652480 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d242e316-ae5a-41cc-8bb1-eb2df681324a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:38.660599 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d242e316-ae5a-41cc-8bb1-eb2df681324a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:38.661443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d242e316-ae5a-41cc-8bb1-eb2df681324a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:38.662373 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d242e316-ae5a-41cc-8bb1-eb2df681324a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:38.664650 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d242e316-ae5a-41cc-8bb1-eb2df681324a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:38.670502 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=95 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:38.871169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d242e316-ae5a-41cc-8bb1-eb2df681324a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:38.889783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d242e316-ae5a-41cc-8bb1-eb2df681324a tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.241982 Jun 23 16:04:38.894927 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 231/468] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:38 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:39.171046 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b280873b-d7dc-4294-8a12-906467380803 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Action: 'create', calling method: .version_select at 0x7fe28d558310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1983304844", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBcEjATRhn0pb10JPWq5rOLdkMq2VK+DHBWqdeWo4xefd9e67aPkYCsu1eFLKKoqdXB6NZs17WKy1a7ZxVYQsIPtdFx/lHRaR3pjYCp9rU91A1f3rl1mxDrz406Icglhw=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:04:39.186635 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-b280873b-d7dc-4294-8a12-906467380803 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Getting quotas for project 42ebe5dc582e4a6b92d4f18002a0ffba. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:04:39.191191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-b280873b-d7dc-4294-8a12-906467380803 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Getting quotas for user c953617a01f1401c966c16467138d628 and project 42ebe5dc582e4a6b92d4f18002a0ffba. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:04:39.218862 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b280873b-d7dc-4294-8a12-906467380803 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.248236 Jun 23 16:04:39.219540 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 238/469] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 23 16:04:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:04:39.907961 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4fe179eb-a61b-445f-8f25-5a86676595c9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:39.911539 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4fe179eb-a61b-445f-8f25-5a86676595c9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:39.918195 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fe179eb-a61b-445f-8f25-5a86676595c9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:39.918916 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fe179eb-a61b-445f-8f25-5a86676595c9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:39.919684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fe179eb-a61b-445f-8f25-5a86676595c9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:39.920164 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4fe179eb-a61b-445f-8f25-5a86676595c9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:40.137155 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4fe179eb-a61b-445f-8f25-5a86676595c9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:40.146121 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4fe179eb-a61b-445f-8f25-5a86676595c9 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.242244 Jun 23 16:04:40.146923 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 232/470] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:39 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:41.165043 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b0e9d626-358d-441f-a3be-808280961478 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:41.166287 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b0e9d626-358d-441f-a3be-808280961478 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:41.168547 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:41.174905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b0e9d626-358d-441f-a3be-808280961478 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:41.175353 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b0e9d626-358d-441f-a3be-808280961478 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:41.176131 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b0e9d626-358d-441f-a3be-808280961478 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:41.176585 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b0e9d626-358d-441f-a3be-808280961478 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:41.205954 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-c879a4bd-73ae-4fa2-bb2d-f91eeda26018 req-4f9a7317-5e71-4d08-8a91-bb94e920548b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d20925-62c2-42d3-9cd4-87cafcfcb78c", "name": "network-vif-plugged", "status": "completed", "tag": "a2b7418c-7a16-44c2-9376-785b79ce1926"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:04:41.218678 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-c879a4bd-73ae-4fa2-bb2d-f91eeda26018 req-4f9a7317-5e71-4d08-8a91-bb94e920548b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:41.219273 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-c879a4bd-73ae-4fa2-bb2d-f91eeda26018 req-4f9a7317-5e71-4d08-8a91-bb94e920548b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:41.234167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-c879a4bd-73ae-4fa2-bb2d-f91eeda26018 req-4f9a7317-5e71-4d08-8a91-bb94e920548b service nova] Creating event network-vif-plugged:a2b7418c-7a16-44c2-9376-785b79ce1926 for instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c on hv-cinder-83538 Jun 23 16:04:41.242254 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-c879a4bd-73ae-4fa2-bb2d-f91eeda26018 req-4f9a7317-5e71-4d08-8a91-bb94e920548b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040940 Jun 23 16:04:41.243005 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 233/471] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:04:41.340444 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b0e9d626-358d-441f-a3be-808280961478 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:41.348154 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b0e9d626-358d-441f-a3be-808280961478 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.189047 Jun 23 16:04:41.348732 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 239/472] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:41 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:42.365095 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8ba7149a-371b-4e79-88fa-6faaf327c4d2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:42.365792 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8ba7149a-371b-4e79-88fa-6faaf327c4d2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:42.372326 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8ba7149a-371b-4e79-88fa-6faaf327c4d2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:42.373042 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8ba7149a-371b-4e79-88fa-6faaf327c4d2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:42.373804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8ba7149a-371b-4e79-88fa-6faaf327c4d2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:42.374391 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8ba7149a-371b-4e79-88fa-6faaf327c4d2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:42.528989 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8ba7149a-371b-4e79-88fa-6faaf327c4d2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:42.537733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8ba7149a-371b-4e79-88fa-6faaf327c4d2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.176832 Jun 23 16:04:42.538598 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 234/473] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:42 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:43.555704 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ec01f271-884d-461a-be30-7bbcaadefbfd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:43.557047 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ec01f271-884d-461a-be30-7bbcaadefbfd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:43.564081 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec01f271-884d-461a-be30-7bbcaadefbfd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:43.564654 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec01f271-884d-461a-be30-7bbcaadefbfd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:43.565499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec01f271-884d-461a-be30-7bbcaadefbfd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:43.566024 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ec01f271-884d-461a-be30-7bbcaadefbfd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:43.705335 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ec01f271-884d-461a-be30-7bbcaadefbfd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:43.713462 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ec01f271-884d-461a-be30-7bbcaadefbfd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1258 microversion: 2.1 time: 0.161657 Jun 23 16:04:43.714026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 240/474] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:43 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:44.729800 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ba304739-91ef-4517-bd1a-3694d33a4b18 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:44.730424 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ba304739-91ef-4517-bd1a-3694d33a4b18 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:44.736527 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba304739-91ef-4517-bd1a-3694d33a4b18 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:44.736968 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba304739-91ef-4517-bd1a-3694d33a4b18 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:44.737760 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba304739-91ef-4517-bd1a-3694d33a4b18 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:44.738204 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ba304739-91ef-4517-bd1a-3694d33a4b18 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:44.874563 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ba304739-91ef-4517-bd1a-3694d33a4b18 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:44.882319 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ba304739-91ef-4517-bd1a-3694d33a4b18 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1442 microversion: 2.1 time: 0.156693 Jun 23 16:04:44.882938 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 235/475] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:44 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:44.900454 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f76261eb-338f-466e-bee8-25306390f60e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:44.901054 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f76261eb-338f-466e-bee8-25306390f60e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:44.907887 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f76261eb-338f-466e-bee8-25306390f60e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:44.908329 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f76261eb-338f-466e-bee8-25306390f60e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:44.909087 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f76261eb-338f-466e-bee8-25306390f60e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:44.909517 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f76261eb-338f-466e-bee8-25306390f60e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:45.053310 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f76261eb-338f-466e-bee8-25306390f60e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:45.061552 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f76261eb-338f-466e-bee8-25306390f60e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1442 microversion: 2.1 time: 0.165213 Jun 23 16:04:45.062108 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 241/476] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:04:44 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:04:45.693611 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c28d83d1-d8d8-439d-9a0e-2aebb00171a2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:45.694829 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c28d83d1-d8d8-439d-9a0e-2aebb00171a2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:45.702469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c28d83d1-d8d8-439d-9a0e-2aebb00171a2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:45.703039 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c28d83d1-d8d8-439d-9a0e-2aebb00171a2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:45.703815 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c28d83d1-d8d8-439d-9a0e-2aebb00171a2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:45.704415 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c28d83d1-d8d8-439d-9a0e-2aebb00171a2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:45.728205 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c28d83d1-d8d8-439d-9a0e-2aebb00171a2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/ips" status: 200 len: 152 microversion: 2.20 time: 0.039767 Jun 23 16:04:45.729144 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 236/477] 10.222.0.46 () {60 vars in 1288 bytes} [Thu Jun 23 16:04:45 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 16:04:47.120455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-89adb547-d9eb-4798-b61e-99fffe7f3929 req-a4d13e6c-266d-4748-bbab-26027d96bba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d20925-62c2-42d3-9cd4-87cafcfcb78c", "tag": "a2b7418c-7a16-44c2-9376-785b79ce1926"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:04:47.133462 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-89adb547-d9eb-4798-b61e-99fffe7f3929 req-a4d13e6c-266d-4748-bbab-26027d96bba3 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:47.134045 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-89adb547-d9eb-4798-b61e-99fffe7f3929 req-a4d13e6c-266d-4748-bbab-26027d96bba3 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:47.146437 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-89adb547-d9eb-4798-b61e-99fffe7f3929 req-a4d13e6c-266d-4748-bbab-26027d96bba3 service nova] Creating event network-changed:a2b7418c-7a16-44c2-9376-785b79ce1926 for instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c on hv-cinder-83538 Jun 23 16:04:47.152147 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-89adb547-d9eb-4798-b61e-99fffe7f3929 req-a4d13e6c-266d-4748-bbab-26027d96bba3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035738 Jun 23 16:04:47.152914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 242/478] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:04:49.451216 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c375cd0e-9c17-4cba-8d14-0b2f81fe6c69 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:04:49.451779 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c375cd0e-9c17-4cba-8d14-0b2f81fe6c69 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:49.457721 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c375cd0e-9c17-4cba-8d14-0b2f81fe6c69 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:49.458170 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c375cd0e-9c17-4cba-8d14-0b2f81fe6c69 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:49.458959 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c375cd0e-9c17-4cba-8d14-0b2f81fe6c69 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:49.459396 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c375cd0e-9c17-4cba-8d14-0b2f81fe6c69 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:49.482982 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-c375cd0e-9c17-4cba-8d14-0b2f81fe6c69 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lazy-loading 'flavor' on Instance uuid 14021a2e-8af8-4292-996e-ea87ff7752e0 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:04:49.740838 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c375cd0e-9c17-4cba-8d14-0b2f81fe6c69 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "POST /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/action" status: 202 len: 0 microversion: 2.20 time: 0.293611 Jun 23 16:04:49.741455 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 237/479] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Jun 23 16:04:49 2022] POST /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:04:49.750991 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ed89fdc9-baa6-4f7e-96d9-398302e8ea3f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:49.751784 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ed89fdc9-baa6-4f7e-96d9-398302e8ea3f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:49.754373 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:49.760230 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed89fdc9-baa6-4f7e-96d9-398302e8ea3f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:49.760682 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed89fdc9-baa6-4f7e-96d9-398302e8ea3f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:49.761448 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed89fdc9-baa6-4f7e-96d9-398302e8ea3f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:49.761874 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed89fdc9-baa6-4f7e-96d9-398302e8ea3f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:49.901201 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ed89fdc9-baa6-4f7e-96d9-398302e8ea3f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:49.909906 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ed89fdc9-baa6-4f7e-96d9-398302e8ea3f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:49.911457 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ed89fdc9-baa6-4f7e-96d9-398302e8ea3f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:49.912612 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ed89fdc9-baa6-4f7e-96d9-398302e8ea3f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.165978 Jun 23 16:04:49.913192 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 243/480] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:04:49 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:04:50.933377 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b9e499b3-07c1-4409-93c8-14cc74d3adeb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:50.934210 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b9e499b3-07c1-4409-93c8-14cc74d3adeb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:50.940842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b9e499b3-07c1-4409-93c8-14cc74d3adeb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:50.941279 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b9e499b3-07c1-4409-93c8-14cc74d3adeb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:50.942063 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b9e499b3-07c1-4409-93c8-14cc74d3adeb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:50.942487 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b9e499b3-07c1-4409-93c8-14cc74d3adeb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:51.080038 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b9e499b3-07c1-4409-93c8-14cc74d3adeb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:51.088029 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b9e499b3-07c1-4409-93c8-14cc74d3adeb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:51.089537 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b9e499b3-07c1-4409-93c8-14cc74d3adeb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:51.090751 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b9e499b3-07c1-4409-93c8-14cc74d3adeb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.162927 Jun 23 16:04:51.091303 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 238/481] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:04:50 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:04:52.109323 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4619adb2-9f74-462c-af2e-0380a910ac0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:52.109929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4619adb2-9f74-462c-af2e-0380a910ac0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:52.116832 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4619adb2-9f74-462c-af2e-0380a910ac0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:52.117276 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4619adb2-9f74-462c-af2e-0380a910ac0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:52.118034 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4619adb2-9f74-462c-af2e-0380a910ac0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:52.118468 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4619adb2-9f74-462c-af2e-0380a910ac0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:52.258264 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4619adb2-9f74-462c-af2e-0380a910ac0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:52.266829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4619adb2-9f74-462c-af2e-0380a910ac0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:52.268379 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4619adb2-9f74-462c-af2e-0380a910ac0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:52.269602 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4619adb2-9f74-462c-af2e-0380a910ac0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.164719 Jun 23 16:04:52.270168 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 244/482] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:04:52 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:04:53.288072 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8cf310f4-1a0d-4c40-9482-33f853586d47 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:53.288681 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8cf310f4-1a0d-4c40-9482-33f853586d47 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:53.294886 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8cf310f4-1a0d-4c40-9482-33f853586d47 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:53.295336 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8cf310f4-1a0d-4c40-9482-33f853586d47 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:53.296088 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8cf310f4-1a0d-4c40-9482-33f853586d47 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:53.296539 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8cf310f4-1a0d-4c40-9482-33f853586d47 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:53.427978 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8cf310f4-1a0d-4c40-9482-33f853586d47 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:53.436311 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8cf310f4-1a0d-4c40-9482-33f853586d47 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:53.437811 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8cf310f4-1a0d-4c40-9482-33f853586d47 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:53.438999 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8cf310f4-1a0d-4c40-9482-33f853586d47 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.154850 Jun 23 16:04:53.439664 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 239/483] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:04:53 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:04:54.457345 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3d41f638-20b2-4565-8547-24d22b784da3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:54.457943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3d41f638-20b2-4565-8547-24d22b784da3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:54.464934 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d41f638-20b2-4565-8547-24d22b784da3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:54.465373 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d41f638-20b2-4565-8547-24d22b784da3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:54.466118 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d41f638-20b2-4565-8547-24d22b784da3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:54.466554 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d41f638-20b2-4565-8547-24d22b784da3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:54.598080 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3d41f638-20b2-4565-8547-24d22b784da3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:54.605987 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3d41f638-20b2-4565-8547-24d22b784da3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:54.607521 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3d41f638-20b2-4565-8547-24d22b784da3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:54.608669 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3d41f638-20b2-4565-8547-24d22b784da3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.155220 Jun 23 16:04:54.609217 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 245/484] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:04:54 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:04:55.626944 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3cb2d5e8-ca7c-4b57-8de8-fed420397003 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:55.627550 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3cb2d5e8-ca7c-4b57-8de8-fed420397003 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:55.629491 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=30 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:04:55.634788 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3cb2d5e8-ca7c-4b57-8de8-fed420397003 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:55.635284 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3cb2d5e8-ca7c-4b57-8de8-fed420397003 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:55.636049 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3cb2d5e8-ca7c-4b57-8de8-fed420397003 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:55.636484 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3cb2d5e8-ca7c-4b57-8de8-fed420397003 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:55.765760 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3cb2d5e8-ca7c-4b57-8de8-fed420397003 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:55.773615 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3cb2d5e8-ca7c-4b57-8de8-fed420397003 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:55.775424 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3cb2d5e8-ca7c-4b57-8de8-fed420397003 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:55.776591 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3cb2d5e8-ca7c-4b57-8de8-fed420397003 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.153604 Jun 23 16:04:55.777135 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 240/485] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:04:55 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:04:56.795696 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2240e9dc-3d83-424d-8988-29afbbd3fa3d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:56.796236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2240e9dc-3d83-424d-8988-29afbbd3fa3d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:56.802657 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2240e9dc-3d83-424d-8988-29afbbd3fa3d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:56.803126 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2240e9dc-3d83-424d-8988-29afbbd3fa3d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:56.803876 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2240e9dc-3d83-424d-8988-29afbbd3fa3d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:56.804301 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2240e9dc-3d83-424d-8988-29afbbd3fa3d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:56.934957 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2240e9dc-3d83-424d-8988-29afbbd3fa3d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:56.942884 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2240e9dc-3d83-424d-8988-29afbbd3fa3d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:56.944391 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2240e9dc-3d83-424d-8988-29afbbd3fa3d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:56.945540 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2240e9dc-3d83-424d-8988-29afbbd3fa3d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.153954 Jun 23 16:04:56.946089 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 246/486] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:04:56 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:04:57.964000 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fd5d2bf0-0867-43c1-91dc-8bd5a8756dc8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:57.965118 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fd5d2bf0-0867-43c1-91dc-8bd5a8756dc8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:57.971169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fd5d2bf0-0867-43c1-91dc-8bd5a8756dc8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:57.971613 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fd5d2bf0-0867-43c1-91dc-8bd5a8756dc8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:57.972370 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fd5d2bf0-0867-43c1-91dc-8bd5a8756dc8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:57.972806 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fd5d2bf0-0867-43c1-91dc-8bd5a8756dc8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:58.099236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fd5d2bf0-0867-43c1-91dc-8bd5a8756dc8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:58.108004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fd5d2bf0-0867-43c1-91dc-8bd5a8756dc8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:58.109573 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fd5d2bf0-0867-43c1-91dc-8bd5a8756dc8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:58.110761 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fd5d2bf0-0867-43c1-91dc-8bd5a8756dc8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.150758 Jun 23 16:04:58.111310 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 241/487] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:04:57 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:04:59.129378 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c7b694c9-b787-4395-ae63-b514b5f15db3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:04:59.129960 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c7b694c9-b787-4395-ae63-b514b5f15db3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:04:59.137026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7b694c9-b787-4395-ae63-b514b5f15db3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:59.137470 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7b694c9-b787-4395-ae63-b514b5f15db3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:59.138229 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7b694c9-b787-4395-ae63-b514b5f15db3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:04:59.138666 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7b694c9-b787-4395-ae63-b514b5f15db3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:04:59.264958 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c7b694c9-b787-4395-ae63-b514b5f15db3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:59.272881 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c7b694c9-b787-4395-ae63-b514b5f15db3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:59.274670 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c7b694c9-b787-4395-ae63-b514b5f15db3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:04:59.275850 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c7b694c9-b787-4395-ae63-b514b5f15db3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.150378 Jun 23 16:04:59.276411 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 247/488] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:04:59 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:00.294575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-445e7cc0-cee9-43bb-a6f7-d66b9634d0d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:00.295215 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-445e7cc0-cee9-43bb-a6f7-d66b9634d0d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:00.301343 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-445e7cc0-cee9-43bb-a6f7-d66b9634d0d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:00.301778 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-445e7cc0-cee9-43bb-a6f7-d66b9634d0d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:00.302524 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-445e7cc0-cee9-43bb-a6f7-d66b9634d0d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:00.302974 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-445e7cc0-cee9-43bb-a6f7-d66b9634d0d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:00.431486 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-445e7cc0-cee9-43bb-a6f7-d66b9634d0d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:00.440853 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-445e7cc0-cee9-43bb-a6f7-d66b9634d0d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:00.442342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-445e7cc0-cee9-43bb-a6f7-d66b9634d0d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:00.443521 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-445e7cc0-cee9-43bb-a6f7-d66b9634d0d9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.152785 Jun 23 16:05:00.444072 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 242/489] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:00 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:01.462196 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-38d85c35-91f7-451d-80ed-b2b818619c90 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:01.462835 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-38d85c35-91f7-451d-80ed-b2b818619c90 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:01.470011 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38d85c35-91f7-451d-80ed-b2b818619c90 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:01.470460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38d85c35-91f7-451d-80ed-b2b818619c90 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:01.471250 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38d85c35-91f7-451d-80ed-b2b818619c90 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:01.471690 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-38d85c35-91f7-451d-80ed-b2b818619c90 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:01.474201 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=76 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:01.603685 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-38d85c35-91f7-451d-80ed-b2b818619c90 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:01.611818 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-38d85c35-91f7-451d-80ed-b2b818619c90 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:01.613336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-38d85c35-91f7-451d-80ed-b2b818619c90 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:01.614493 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-38d85c35-91f7-451d-80ed-b2b818619c90 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.156222 Jun 23 16:05:01.615092 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 248/490] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:01 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:02.633176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2f56fe80-ba9a-433f-b3a6-44c7524bdd7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:02.633781 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2f56fe80-ba9a-433f-b3a6-44c7524bdd7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:02.640737 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f56fe80-ba9a-433f-b3a6-44c7524bdd7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:02.641246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f56fe80-ba9a-433f-b3a6-44c7524bdd7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:02.642121 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f56fe80-ba9a-433f-b3a6-44c7524bdd7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:02.642556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f56fe80-ba9a-433f-b3a6-44c7524bdd7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:02.774636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2f56fe80-ba9a-433f-b3a6-44c7524bdd7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:02.782724 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2f56fe80-ba9a-433f-b3a6-44c7524bdd7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:02.784244 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2f56fe80-ba9a-433f-b3a6-44c7524bdd7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:02.785408 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2f56fe80-ba9a-433f-b3a6-44c7524bdd7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.156171 Jun 23 16:05:02.786158 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 243/491] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:02 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:03.804105 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-083b5b60-5d5c-4805-9e45-84079561920a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:03.804719 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-083b5b60-5d5c-4805-9e45-84079561920a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:03.812071 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-083b5b60-5d5c-4805-9e45-84079561920a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:03.812519 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-083b5b60-5d5c-4805-9e45-84079561920a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:03.813308 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-083b5b60-5d5c-4805-9e45-84079561920a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:03.813746 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-083b5b60-5d5c-4805-9e45-84079561920a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:03.940376 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-083b5b60-5d5c-4805-9e45-84079561920a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:03.948315 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-083b5b60-5d5c-4805-9e45-84079561920a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:03.949833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-083b5b60-5d5c-4805-9e45-84079561920a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:03.951015 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-083b5b60-5d5c-4805-9e45-84079561920a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.150844 Jun 23 16:05:03.951574 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 249/492] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:03 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:04.969114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dfb2acd3-61de-4ff6-a3ea-b4e70b3d5c38 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:04.969695 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dfb2acd3-61de-4ff6-a3ea-b4e70b3d5c38 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:04.975721 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dfb2acd3-61de-4ff6-a3ea-b4e70b3d5c38 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:04.976160 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dfb2acd3-61de-4ff6-a3ea-b4e70b3d5c38 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:04.976900 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dfb2acd3-61de-4ff6-a3ea-b4e70b3d5c38 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:04.977327 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dfb2acd3-61de-4ff6-a3ea-b4e70b3d5c38 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:05.103530 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dfb2acd3-61de-4ff6-a3ea-b4e70b3d5c38 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:05.111964 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dfb2acd3-61de-4ff6-a3ea-b4e70b3d5c38 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:05.113482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dfb2acd3-61de-4ff6-a3ea-b4e70b3d5c38 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:05.114647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dfb2acd3-61de-4ff6-a3ea-b4e70b3d5c38 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.149477 Jun 23 16:05:05.115231 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 244/493] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:04 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:06.133494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c9df2966-f043-41b8-bddd-b185ff553f86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:06.134106 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c9df2966-f043-41b8-bddd-b185ff553f86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:06.141275 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9df2966-f043-41b8-bddd-b185ff553f86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:06.141723 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9df2966-f043-41b8-bddd-b185ff553f86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:06.142484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9df2966-f043-41b8-bddd-b185ff553f86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:06.142955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c9df2966-f043-41b8-bddd-b185ff553f86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:06.274132 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c9df2966-f043-41b8-bddd-b185ff553f86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:06.282485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c9df2966-f043-41b8-bddd-b185ff553f86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:06.284028 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c9df2966-f043-41b8-bddd-b185ff553f86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:06.285179 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c9df2966-f043-41b8-bddd-b185ff553f86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.155639 Jun 23 16:05:06.285728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 250/494] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:06 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:07.108549 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1760294689", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1983304844", "security_groups": [{"name": "tempest-secgroup-smoke-1309684319"}], "block_device_mapping_v2": [{"uuid": "111b1162-f970-4a28-9c9d-2832578f0391", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebbee555-602b-4494-b3d4-95250f3b8a84"}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:07.220295 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] validate_networks() for [('ebbee555-602b-4494-b3d4-95250f3b8a84', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:05:07.303785 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e264807b-f0f1-46fb-982e-588bfdf3573c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:07.304495 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e264807b-f0f1-46fb-982e-588bfdf3573c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:07.311242 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e264807b-f0f1-46fb-982e-588bfdf3573c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:07.311828 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e264807b-f0f1-46fb-982e-588bfdf3573c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:07.312662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e264807b-f0f1-46fb-982e-588bfdf3573c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:07.313212 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e264807b-f0f1-46fb-982e-588bfdf3573c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:07.450978 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e264807b-f0f1-46fb-982e-588bfdf3573c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:07.459175 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e264807b-f0f1-46fb-982e-588bfdf3573c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:07.460720 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e264807b-f0f1-46fb-982e-588bfdf3573c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:07.461848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e264807b-f0f1-46fb-982e-588bfdf3573c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.162244 Jun 23 16:05:07.462404 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 251/495] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:07 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:05:07.710323 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:05:07.710768 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:05:07.711263 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:05:07.711670 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:05:07.712079 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:05:07.721614 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:07.722061 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:07.722894 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:07.723328 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:07.741745 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Getting quotas for project 42ebe5dc582e4a6b92d4f18002a0ffba. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:05:07.749340 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Getting quotas for user c953617a01f1401c966c16467138d628 and project 42ebe5dc582e4a6b92d4f18002a0ffba. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:05:07.807427 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:05:07.810106 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='111b1162-f970-4a28-9c9d-2832578f0391',volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:05:07.940467 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b6833e39-9f88-4680-a1b4-48fb8a1baef2 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.836261 Jun 23 16:05:07.942892 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 245/496] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:05:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:05:07.952013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5d4cc4ad-479b-43f1-8d37-cee52216f175 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:07.952626 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5d4cc4ad-479b-43f1-8d37-cee52216f175 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:08.007468 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5d4cc4ad-479b-43f1-8d37-cee52216f175 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:08.016142 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5d4cc4ad-479b-43f1-8d37-cee52216f175 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1095 microversion: 2.1 time: 0.068521 Jun 23 16:05:08.025829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 252/497] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:07 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:08.231751 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-40ca8f1a-5d66-45da-9453-20ef3211169a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:08.232862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-40ca8f1a-5d66-45da-9453-20ef3211169a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:08.239266 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40ca8f1a-5d66-45da-9453-20ef3211169a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:08.239945 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40ca8f1a-5d66-45da-9453-20ef3211169a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:08.240870 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40ca8f1a-5d66-45da-9453-20ef3211169a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:08.241441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40ca8f1a-5d66-45da-9453-20ef3211169a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:08.268122 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-40ca8f1a-5d66-45da-9453-20ef3211169a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/ips" status: 200 len: 149 microversion: 2.1 time: 0.040619 Jun 23 16:05:08.269268 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 246/498] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 23 16:05:08 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:05:08.480015 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8f18c7d6-4a66-4a0a-990d-bcee7610e00a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:08.480631 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8f18c7d6-4a66-4a0a-990d-bcee7610e00a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:08.490239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8f18c7d6-4a66-4a0a-990d-bcee7610e00a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:08.490723 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8f18c7d6-4a66-4a0a-990d-bcee7610e00a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:08.492164 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8f18c7d6-4a66-4a0a-990d-bcee7610e00a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:08.492775 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8f18c7d6-4a66-4a0a-990d-bcee7610e00a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:08.642915 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8f18c7d6-4a66-4a0a-990d-bcee7610e00a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:08.651989 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8f18c7d6-4a66-4a0a-990d-bcee7610e00a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:08.653509 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8f18c7d6-4a66-4a0a-990d-bcee7610e00a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:08.654960 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8f18c7d6-4a66-4a0a-990d-bcee7610e00a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.179242 Jun 23 16:05:08.655615 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 253/499] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:08 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:05:09.033575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0706710e-fb39-4ef6-97f5-8271544e3279 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:09.034108 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0706710e-fb39-4ef6-97f5-8271544e3279 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:09.040138 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0706710e-fb39-4ef6-97f5-8271544e3279 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:09.040587 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0706710e-fb39-4ef6-97f5-8271544e3279 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:09.041344 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0706710e-fb39-4ef6-97f5-8271544e3279 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:09.041783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0706710e-fb39-4ef6-97f5-8271544e3279 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:09.045611 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:09.104222 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0706710e-fb39-4ef6-97f5-8271544e3279 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:09.111703 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0706710e-fb39-4ef6-97f5-8271544e3279 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1137 microversion: 2.1 time: 0.082059 Jun 23 16:05:09.112263 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 247/500] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:09 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:09.646178 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c7e9b0f3-25ad-4c09-929d-2b30191f5f46 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34279923-4f36-446c-8b64-0ec926119801"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:09.647390 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c7e9b0f3-25ad-4c09-929d-2b30191f5f46 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:09.654086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7e9b0f3-25ad-4c09-929d-2b30191f5f46 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:09.654531 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7e9b0f3-25ad-4c09-929d-2b30191f5f46 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:09.655339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7e9b0f3-25ad-4c09-929d-2b30191f5f46 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:09.655778 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c7e9b0f3-25ad-4c09-929d-2b30191f5f46 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:09.673829 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ca2343d2-d3fc-4a38-89d2-8e0f6215fb9d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:09.674433 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ca2343d2-d3fc-4a38-89d2-8e0f6215fb9d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:09.682326 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ca2343d2-d3fc-4a38-89d2-8e0f6215fb9d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:09.683429 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ca2343d2-d3fc-4a38-89d2-8e0f6215fb9d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:09.684270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ca2343d2-d3fc-4a38-89d2-8e0f6215fb9d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:09.685203 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ca2343d2-d3fc-4a38-89d2-8e0f6215fb9d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:09.918999 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ca2343d2-d3fc-4a38-89d2-8e0f6215fb9d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:09.926894 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ca2343d2-d3fc-4a38-89d2-8e0f6215fb9d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:09.928516 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ca2343d2-d3fc-4a38-89d2-8e0f6215fb9d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:09.929685 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ca2343d2-d3fc-4a38-89d2-8e0f6215fb9d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.259748 Jun 23 16:05:09.930305 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 248/501] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:09 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:05:09.957390 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c7e9b0f3-25ad-4c09-929d-2b30191f5f46 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315011 Jun 23 16:05:09.957993 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 254/502] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:05:09 2022] POST /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:05:10.129465 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4000bcd0-3429-4313-a53a-3b460732bb8e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:10.130076 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4000bcd0-3429-4313-a53a-3b460732bb8e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:10.137114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4000bcd0-3429-4313-a53a-3b460732bb8e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:10.137563 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4000bcd0-3429-4313-a53a-3b460732bb8e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:10.138329 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4000bcd0-3429-4313-a53a-3b460732bb8e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:10.138791 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4000bcd0-3429-4313-a53a-3b460732bb8e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:10.226452 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4000bcd0-3429-4313-a53a-3b460732bb8e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:10.233290 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4000bcd0-3429-4313-a53a-3b460732bb8e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1211 microversion: 2.1 time: 0.107677 Jun 23 16:05:10.234139 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 249/503] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:10 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1211 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:10.950178 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4262573b-ca4c-4c37-86e9-9fab5adcefde tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:10.951044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4262573b-ca4c-4c37-86e9-9fab5adcefde tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:10.959279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4262573b-ca4c-4c37-86e9-9fab5adcefde tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:10.959818 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4262573b-ca4c-4c37-86e9-9fab5adcefde tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:10.960602 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4262573b-ca4c-4c37-86e9-9fab5adcefde tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:10.961040 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4262573b-ca4c-4c37-86e9-9fab5adcefde tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:11.119234 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4262573b-ca4c-4c37-86e9-9fab5adcefde tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:11.128342 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4262573b-ca4c-4c37-86e9-9fab5adcefde tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:11.129854 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4262573b-ca4c-4c37-86e9-9fab5adcefde tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:11.131078 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4262573b-ca4c-4c37-86e9-9fab5adcefde tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.186836 Jun 23 16:05:11.131644 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 255/504] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:10 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:11.251134 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-aaba1d7e-d2f4-49be-9f7d-a028460bfd1a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:11.251898 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-aaba1d7e-d2f4-49be-9f7d-a028460bfd1a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:11.257976 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aaba1d7e-d2f4-49be-9f7d-a028460bfd1a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:11.258434 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aaba1d7e-d2f4-49be-9f7d-a028460bfd1a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:11.259226 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aaba1d7e-d2f4-49be-9f7d-a028460bfd1a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:11.259656 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-aaba1d7e-d2f4-49be-9f7d-a028460bfd1a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:11.485072 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-aaba1d7e-d2f4-49be-9f7d-a028460bfd1a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:11.493345 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-aaba1d7e-d2f4-49be-9f7d-a028460bfd1a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.246006 Jun 23 16:05:11.494618 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 250/505] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:11 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:11.639815 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-ebc8c5db-5eba-41cd-bc16-c7556563fb41 req-8a2f24a6-3a96-486b-a439-83d9ca062667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1", "tag": "ee05b6a8-bcfd-4af9-baec-36320570c58e"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:11.644160 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=36 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:11.666427 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-ebc8c5db-5eba-41cd-bc16-c7556563fb41 req-8a2f24a6-3a96-486b-a439-83d9ca062667 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:11.667545 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-ebc8c5db-5eba-41cd-bc16-c7556563fb41 req-8a2f24a6-3a96-486b-a439-83d9ca062667 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:11.679437 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-ebc8c5db-5eba-41cd-bc16-c7556563fb41 req-8a2f24a6-3a96-486b-a439-83d9ca062667 service nova] Creating event network-changed:ee05b6a8-bcfd-4af9-baec-36320570c58e for instance af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 on hv-cinder-83538 Jun 23 16:05:11.684313 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-ebc8c5db-5eba-41cd-bc16-c7556563fb41 req-8a2f24a6-3a96-486b-a439-83d9ca062667 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048530 Jun 23 16:05:11.685318 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 256/506] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:05:12.149131 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-18a58933-0652-4436-8c68-351c108318cf tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:12.149996 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-18a58933-0652-4436-8c68-351c108318cf tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:12.156188 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-18a58933-0652-4436-8c68-351c108318cf tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:12.156663 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-18a58933-0652-4436-8c68-351c108318cf tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:12.157418 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-18a58933-0652-4436-8c68-351c108318cf tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:12.157876 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-18a58933-0652-4436-8c68-351c108318cf tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:12.288709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-18a58933-0652-4436-8c68-351c108318cf tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:12.301196 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-18a58933-0652-4436-8c68-351c108318cf tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:12.303155 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-18a58933-0652-4436-8c68-351c108318cf tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:12.304327 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-18a58933-0652-4436-8c68-351c108318cf tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.158966 Jun 23 16:05:12.304882 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 251/507] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:12 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:12.512830 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-51cc9b72-4473-42d2-915c-4f83feafdfbc tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:12.513520 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-51cc9b72-4473-42d2-915c-4f83feafdfbc tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:12.519798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51cc9b72-4473-42d2-915c-4f83feafdfbc tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:12.520240 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51cc9b72-4473-42d2-915c-4f83feafdfbc tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:12.520990 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51cc9b72-4473-42d2-915c-4f83feafdfbc tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:12.521418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51cc9b72-4473-42d2-915c-4f83feafdfbc tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:12.656638 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-51cc9b72-4473-42d2-915c-4f83feafdfbc tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:12.664312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-51cc9b72-4473-42d2-915c-4f83feafdfbc tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.157054 Jun 23 16:05:12.664881 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 257/508] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:12 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:13.322633 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5df66825-ce44-4174-a19c-2454f3f20f63 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:13.323785 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5df66825-ce44-4174-a19c-2454f3f20f63 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:13.330228 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5df66825-ce44-4174-a19c-2454f3f20f63 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:13.330673 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5df66825-ce44-4174-a19c-2454f3f20f63 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:13.331481 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5df66825-ce44-4174-a19c-2454f3f20f63 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:13.331918 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5df66825-ce44-4174-a19c-2454f3f20f63 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:13.472239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5df66825-ce44-4174-a19c-2454f3f20f63 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:13.482256 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5df66825-ce44-4174-a19c-2454f3f20f63 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:13.484103 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5df66825-ce44-4174-a19c-2454f3f20f63 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:13.486007 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5df66825-ce44-4174-a19c-2454f3f20f63 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.167094 Jun 23 16:05:13.487297 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 252/509] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:13 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:13.681750 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-87668409-71b0-4a94-9747-5bdab0f64cb7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:13.682962 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-87668409-71b0-4a94-9747-5bdab0f64cb7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:13.689403 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-87668409-71b0-4a94-9747-5bdab0f64cb7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:13.690071 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-87668409-71b0-4a94-9747-5bdab0f64cb7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:13.690876 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-87668409-71b0-4a94-9747-5bdab0f64cb7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:13.691302 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-87668409-71b0-4a94-9747-5bdab0f64cb7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:13.829983 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-87668409-71b0-4a94-9747-5bdab0f64cb7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:13.837654 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-87668409-71b0-4a94-9747-5bdab0f64cb7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.160068 Jun 23 16:05:13.838232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 258/510] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:13 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:14.505362 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4d9706a1-8450-4aa7-b20f-012069263c98 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:14.505907 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4d9706a1-8450-4aa7-b20f-012069263c98 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:14.512022 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d9706a1-8450-4aa7-b20f-012069263c98 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:14.512455 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d9706a1-8450-4aa7-b20f-012069263c98 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:14.513209 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d9706a1-8450-4aa7-b20f-012069263c98 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:14.513633 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4d9706a1-8450-4aa7-b20f-012069263c98 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:14.648740 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4d9706a1-8450-4aa7-b20f-012069263c98 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:14.657391 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4d9706a1-8450-4aa7-b20f-012069263c98 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:14.658935 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4d9706a1-8450-4aa7-b20f-012069263c98 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:14.660107 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4d9706a1-8450-4aa7-b20f-012069263c98 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1744 microversion: 2.20 time: 0.159354 Jun 23 16:05:14.660665 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 253/511] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:14 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:14.855799 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-35090e47-62a0-4c83-b926-ad38c688b0d8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:14.856434 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-35090e47-62a0-4c83-b926-ad38c688b0d8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:14.862909 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35090e47-62a0-4c83-b926-ad38c688b0d8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:14.863353 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35090e47-62a0-4c83-b926-ad38c688b0d8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:14.864112 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35090e47-62a0-4c83-b926-ad38c688b0d8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:14.864544 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-35090e47-62a0-4c83-b926-ad38c688b0d8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:14.994997 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-35090e47-62a0-4c83-b926-ad38c688b0d8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:15.002780 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-35090e47-62a0-4c83-b926-ad38c688b0d8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.151288 Jun 23 16:05:15.003374 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 259/512] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:14 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:15.372208 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-774a5437-1520-46a7-ba4e-675dee3271e3 req-c882bab5-b692-4015-82d7-a7f24eee7b9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14021a2e-8af8-4292-996e-ea87ff7752e0", "name": "network-vif-plugged", "status": "completed", "tag": "15db635b-5851-4528-8f58-f9ba091f51a6"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:15.380708 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-774a5437-1520-46a7-ba4e-675dee3271e3 req-c882bab5-b692-4015-82d7-a7f24eee7b9b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:15.381149 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-774a5437-1520-46a7-ba4e-675dee3271e3 req-c882bab5-b692-4015-82d7-a7f24eee7b9b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:15.393799 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-774a5437-1520-46a7-ba4e-675dee3271e3 req-c882bab5-b692-4015-82d7-a7f24eee7b9b service nova] Creating event network-vif-plugged:15db635b-5851-4528-8f58-f9ba091f51a6 for instance 14021a2e-8af8-4292-996e-ea87ff7752e0 on hv-cinder-83538 Jun 23 16:05:15.398997 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-774a5437-1520-46a7-ba4e-675dee3271e3 req-c882bab5-b692-4015-82d7-a7f24eee7b9b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030891 Jun 23 16:05:15.399856 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 254/513] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:05:15.678555 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-71c5a8f7-28e9-4464-97bb-93f5cd2705e4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:15.679191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-71c5a8f7-28e9-4464-97bb-93f5cd2705e4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:15.685826 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-71c5a8f7-28e9-4464-97bb-93f5cd2705e4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:15.686276 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-71c5a8f7-28e9-4464-97bb-93f5cd2705e4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:15.687063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-71c5a8f7-28e9-4464-97bb-93f5cd2705e4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:15.687500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-71c5a8f7-28e9-4464-97bb-93f5cd2705e4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:15.819144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-71c5a8f7-28e9-4464-97bb-93f5cd2705e4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:15.827124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-71c5a8f7-28e9-4464-97bb-93f5cd2705e4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:15.828739 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-71c5a8f7-28e9-4464-97bb-93f5cd2705e4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:15.829844 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-71c5a8f7-28e9-4464-97bb-93f5cd2705e4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1744 microversion: 2.20 time: 0.155271 Jun 23 16:05:15.830408 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 260/514] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:15 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:16.020907 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5a5105cc-ff27-461b-b75b-3018e101176a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:16.021606 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5a5105cc-ff27-461b-b75b-3018e101176a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:16.028675 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5105cc-ff27-461b-b75b-3018e101176a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:16.029128 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5105cc-ff27-461b-b75b-3018e101176a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:16.029890 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5105cc-ff27-461b-b75b-3018e101176a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:16.030325 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5a5105cc-ff27-461b-b75b-3018e101176a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:16.162124 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5a5105cc-ff27-461b-b75b-3018e101176a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:16.170220 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5a5105cc-ff27-461b-b75b-3018e101176a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.153689 Jun 23 16:05:16.170813 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 255/515] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:16 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:16.847564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5cb0a58a-a07b-4bc0-bb17-3095e0b32db1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:16.848239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5cb0a58a-a07b-4bc0-bb17-3095e0b32db1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:16.854566 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cb0a58a-a07b-4bc0-bb17-3095e0b32db1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:16.855036 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cb0a58a-a07b-4bc0-bb17-3095e0b32db1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:16.855782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cb0a58a-a07b-4bc0-bb17-3095e0b32db1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:16.856209 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cb0a58a-a07b-4bc0-bb17-3095e0b32db1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:16.984218 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5cb0a58a-a07b-4bc0-bb17-3095e0b32db1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:16.992183 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5cb0a58a-a07b-4bc0-bb17-3095e0b32db1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:16.993717 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5cb0a58a-a07b-4bc0-bb17-3095e0b32db1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:16.995479 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5cb0a58a-a07b-4bc0-bb17-3095e0b32db1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1744 microversion: 2.20 time: 0.151223 Jun 23 16:05:16.996045 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 261/516] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:16 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:17.187441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a471ab47-f9d1-4883-b1b5-873f453670ae tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:17.188054 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a471ab47-f9d1-4883-b1b5-873f453670ae tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:17.194017 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a471ab47-f9d1-4883-b1b5-873f453670ae tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:17.194491 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a471ab47-f9d1-4883-b1b5-873f453670ae tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:17.195285 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a471ab47-f9d1-4883-b1b5-873f453670ae tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:17.195725 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a471ab47-f9d1-4883-b1b5-873f453670ae tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:17.328051 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a471ab47-f9d1-4883-b1b5-873f453670ae tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:17.335638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a471ab47-f9d1-4883-b1b5-873f453670ae tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.152012 Jun 23 16:05:17.336202 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 256/517] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:17 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:18.013870 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8461d97f-7c67-4901-acfc-81c72378737c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:18.014562 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8461d97f-7c67-4901-acfc-81c72378737c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:18.017001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:18.022323 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8461d97f-7c67-4901-acfc-81c72378737c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:18.022787 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8461d97f-7c67-4901-acfc-81c72378737c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:18.023539 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8461d97f-7c67-4901-acfc-81c72378737c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:18.023969 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8461d97f-7c67-4901-acfc-81c72378737c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:18.155788 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8461d97f-7c67-4901-acfc-81c72378737c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:18.163679 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8461d97f-7c67-4901-acfc-81c72378737c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:18.165180 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8461d97f-7c67-4901-acfc-81c72378737c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:18.166323 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8461d97f-7c67-4901-acfc-81c72378737c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1744 microversion: 2.20 time: 0.156873 Jun 23 16:05:18.166900 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 262/518] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:18 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:18.352618 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-14ff8911-8f98-4159-abab-d5d322577508 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:18.353221 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-14ff8911-8f98-4159-abab-d5d322577508 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:18.355186 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:18.355958 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:18.361402 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-14ff8911-8f98-4159-abab-d5d322577508 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:18.361839 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-14ff8911-8f98-4159-abab-d5d322577508 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:18.362585 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-14ff8911-8f98-4159-abab-d5d322577508 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:18.363034 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-14ff8911-8f98-4159-abab-d5d322577508 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:18.498183 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-14ff8911-8f98-4159-abab-d5d322577508 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:18.505595 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-14ff8911-8f98-4159-abab-d5d322577508 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.156836 Jun 23 16:05:18.506238 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 257/519] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:18 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:05:18.538175 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4cfc32a5-8823-4929-85aa-1d3e2f405cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: .version_select at 0x7fe28d55f8b0>, body: {"keypair": {"name": "tempest-keypair-2128415517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRvNXLTFf6rKnvv6qe0U0bby2mf73N8lGBs2GYMw1OcpfYjGw43hG+9yBKkAA+vZdxtAgy44b/BBLmtBasu0ly8Ey6NM8HGycj10+2KNm5zKxkKO1B8BFouu9tEjmkAew=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:18.553487 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-4cfc32a5-8823-4929-85aa-1d3e2f405cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for project 2063fb24abb5408794361a9032e56d3f. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:05:18.557777 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-4cfc32a5-8823-4929-85aa-1d3e2f405cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for user dac5e323b42f41859c85709a2b49623b and project 2063fb24abb5408794361a9032e56d3f. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:05:18.580196 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4cfc32a5-8823-4929-85aa-1d3e2f405cd5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045964 Jun 23 16:05:18.580842 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 263/520] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 23 16:05:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:05:19.184610 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2647e79f-55ff-4cc8-a098-0432c6c21c6f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:19.185363 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2647e79f-55ff-4cc8-a098-0432c6c21c6f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:19.191405 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2647e79f-55ff-4cc8-a098-0432c6c21c6f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:19.191851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2647e79f-55ff-4cc8-a098-0432c6c21c6f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:19.192615 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2647e79f-55ff-4cc8-a098-0432c6c21c6f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:19.193054 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2647e79f-55ff-4cc8-a098-0432c6c21c6f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:19.393174 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2647e79f-55ff-4cc8-a098-0432c6c21c6f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:19.401268 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2647e79f-55ff-4cc8-a098-0432c6c21c6f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:19.403411 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2647e79f-55ff-4cc8-a098-0432c6c21c6f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:19.404588 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2647e79f-55ff-4cc8-a098-0432c6c21c6f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1744 microversion: 2.20 time: 0.223956 Jun 23 16:05:19.405133 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 258/521] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:19 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:19.522968 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-886e71d8-4faf-47d1-b0f3-9592cfc47fca tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:19.523604 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-886e71d8-4faf-47d1-b0f3-9592cfc47fca tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:19.535104 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-886e71d8-4faf-47d1-b0f3-9592cfc47fca tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:19.535548 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-886e71d8-4faf-47d1-b0f3-9592cfc47fca tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:19.536510 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-886e71d8-4faf-47d1-b0f3-9592cfc47fca tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:19.536975 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-886e71d8-4faf-47d1-b0f3-9592cfc47fca tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:19.673542 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-886e71d8-4faf-47d1-b0f3-9592cfc47fca tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:19.681473 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-886e71d8-4faf-47d1-b0f3-9592cfc47fca tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.162791 Jun 23 16:05:19.681977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 264/522] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:19 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:19.962176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2100005454", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58e7bb1c-ec3e-4fa3-be98-70515568e1d4"}], "security_groups": [{"name": "tempest-securitygroup--1233674135"}], "key_name": "tempest-keypair-2128415517", "user_data": "}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:20.063789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] validate_networks() for [('58e7bb1c-ec3e-4fa3-be98-70515568e1d4', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:05:20.422992 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-77d16af8-91a8-4f8c-842c-7bdd0aa5e0ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:20.423598 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-77d16af8-91a8-4f8c-842c-7bdd0aa5e0ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:20.424405 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:05:20.424852 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:05:20.425273 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:05:20.425674 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:05:20.426597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:05:20.429797 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77d16af8-91a8-4f8c-842c-7bdd0aa5e0ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:20.430243 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77d16af8-91a8-4f8c-842c-7bdd0aa5e0ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:20.431040 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77d16af8-91a8-4f8c-842c-7bdd0aa5e0ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:20.431475 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-77d16af8-91a8-4f8c-842c-7bdd0aa5e0ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:20.435478 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:20.435914 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:20.436700 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:20.437124 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:20.455750 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for project 2063fb24abb5408794361a9032e56d3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:05:20.459947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for user dac5e323b42f41859c85709a2b49623b and project 2063fb24abb5408794361a9032e56d3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:05:20.471472 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:05:20.473854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:05:20.523273 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8fc1e59a-edb5-44ca-846a-d6af81b38e29 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.565255 Jun 23 16:05:20.527814 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 259/523] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:05:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:05:20.534507 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-724c4286-6fcf-4aca-bd00-64e9b93910f6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:20.535258 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-724c4286-6fcf-4aca-bd00-64e9b93910f6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:20.585651 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-77d16af8-91a8-4f8c-842c-7bdd0aa5e0ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:20.594298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-77d16af8-91a8-4f8c-842c-7bdd0aa5e0ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:20.595987 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-77d16af8-91a8-4f8c-842c-7bdd0aa5e0ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:20.596418 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-724c4286-6fcf-4aca-bd00-64e9b93910f6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:20.597246 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-77d16af8-91a8-4f8c-842c-7bdd0aa5e0ca tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1744 microversion: 2.20 time: 0.178310 Jun 23 16:05:20.597870 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 265/524] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:20 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:05:20.603348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-724c4286-6fcf-4aca-bd00-64e9b93910f6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1242 microversion: 2.1 time: 0.072799 Jun 23 16:05:20.603903 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 260/525] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:20 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:20.698455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-dca5c0d3-78b2-4bfd-b0d7-6fa1de182c06 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:20.699817 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-dca5c0d3-78b2-4bfd-b0d7-6fa1de182c06 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:20.706177 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dca5c0d3-78b2-4bfd-b0d7-6fa1de182c06 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:20.706730 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dca5c0d3-78b2-4bfd-b0d7-6fa1de182c06 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:20.707556 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dca5c0d3-78b2-4bfd-b0d7-6fa1de182c06 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:20.708057 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-dca5c0d3-78b2-4bfd-b0d7-6fa1de182c06 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:20.712101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:20.848509 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-dca5c0d3-78b2-4bfd-b0d7-6fa1de182c06 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:20.857214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-dca5c0d3-78b2-4bfd-b0d7-6fa1de182c06 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.162625 Jun 23 16:05:20.857946 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 266/526] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:20 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:21.622995 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-19107662-2ff9-4c3d-855c-f43a6fbb5e47 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:21.624317 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1bda7b46-bd7a-483c-8a8f-609650435287 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:21.624931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-19107662-2ff9-4c3d-855c-f43a6fbb5e47 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:21.628848 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1bda7b46-bd7a-483c-8a8f-609650435287 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:21.633525 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-19107662-2ff9-4c3d-855c-f43a6fbb5e47 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:21.634332 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-19107662-2ff9-4c3d-855c-f43a6fbb5e47 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:21.635267 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-19107662-2ff9-4c3d-855c-f43a6fbb5e47 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:21.635808 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bda7b46-bd7a-483c-8a8f-609650435287 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:21.636775 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-19107662-2ff9-4c3d-855c-f43a6fbb5e47 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:21.636898 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bda7b46-bd7a-483c-8a8f-609650435287 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:21.637976 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bda7b46-bd7a-483c-8a8f-609650435287 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:21.638583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bda7b46-bd7a-483c-8a8f-609650435287 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:21.708224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-19107662-2ff9-4c3d-855c-f43a6fbb5e47 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:21.717024 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-19107662-2ff9-4c3d-855c-f43a6fbb5e47 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1300 microversion: 2.1 time: 0.100691 Jun 23 16:05:21.717717 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 267/527] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:21 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1300 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:05:21.874196 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-487f777b-faf6-49d7-8020-0f011590bcd7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:21.874835 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-487f777b-faf6-49d7-8020-0f011590bcd7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:21.881090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-487f777b-faf6-49d7-8020-0f011590bcd7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:21.881545 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-487f777b-faf6-49d7-8020-0f011590bcd7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:21.882315 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-487f777b-faf6-49d7-8020-0f011590bcd7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:21.882953 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-487f777b-faf6-49d7-8020-0f011590bcd7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:22.019835 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-487f777b-faf6-49d7-8020-0f011590bcd7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:22.028224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-487f777b-faf6-49d7-8020-0f011590bcd7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.158582 Jun 23 16:05:22.028898 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 268/528] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:21 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:05:22.032101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1bda7b46-bd7a-483c-8a8f-609650435287 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:22.040587 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1bda7b46-bd7a-483c-8a8f-609650435287 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:22.042081 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1bda7b46-bd7a-483c-8a8f-609650435287 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:22.043852 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1bda7b46-bd7a-483c-8a8f-609650435287 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1744 microversion: 2.20 time: 0.431981 Jun 23 16:05:22.044401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 261/529] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:21 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1744 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:22.734840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f5ae30bb-8859-49e6-9953-281f308bfa2e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:22.735428 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f5ae30bb-8859-49e6-9953-281f308bfa2e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:22.742331 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5ae30bb-8859-49e6-9953-281f308bfa2e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:22.742829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5ae30bb-8859-49e6-9953-281f308bfa2e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:22.743616 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5ae30bb-8859-49e6-9953-281f308bfa2e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:22.744283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f5ae30bb-8859-49e6-9953-281f308bfa2e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:22.883356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f5ae30bb-8859-49e6-9953-281f308bfa2e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:22.892214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f5ae30bb-8859-49e6-9953-281f308bfa2e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.161475 Jun 23 16:05:22.893652 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 269/530] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:22 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:23.046716 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9d189389-0f09-468e-ad9b-cf85666463a0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:23.047511 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9d189389-0f09-468e-ad9b-cf85666463a0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:23.062450 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-42b9c14a-aebe-43f7-913b-da9770f3ab30 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:23.063145 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-42b9c14a-aebe-43f7-913b-da9770f3ab30 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:23.087027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d189389-0f09-468e-ad9b-cf85666463a0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:23.088015 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d189389-0f09-468e-ad9b-cf85666463a0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:23.091330 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-42b9c14a-aebe-43f7-913b-da9770f3ab30 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:23.092090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-42b9c14a-aebe-43f7-913b-da9770f3ab30 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:23.093108 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-42b9c14a-aebe-43f7-913b-da9770f3ab30 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:23.093749 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-42b9c14a-aebe-43f7-913b-da9770f3ab30 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:23.107047 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d189389-0f09-468e-ad9b-cf85666463a0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:23.107507 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d189389-0f09-468e-ad9b-cf85666463a0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:23.305018 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-42b9c14a-aebe-43f7-913b-da9770f3ab30 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:23.315800 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-42b9c14a-aebe-43f7-913b-da9770f3ab30 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:23.318179 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-42b9c14a-aebe-43f7-913b-da9770f3ab30 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:23.320419 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-42b9c14a-aebe-43f7-913b-da9770f3ab30 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.262425 Jun 23 16:05:23.321680 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 270/531] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:23 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:23.423974 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9d189389-0f09-468e-ad9b-cf85666463a0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:23.432798 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9d189389-0f09-468e-ad9b-cf85666463a0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.391141 Jun 23 16:05:23.444005 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 262/532] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:23 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:23.533199 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-b5140f90-3432-42e0-ac88-d1655bc708b2 req-8c866678-5e60-4803-a08c-f575a304e9e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b18125-a7dc-4adf-8537-a1c18e79ccf7", "tag": "381f3466-20ef-4ea9-928c-46f57ce0f0d8"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:23.546550 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-b5140f90-3432-42e0-ac88-d1655bc708b2 req-8c866678-5e60-4803-a08c-f575a304e9e5 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:23.549240 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-b5140f90-3432-42e0-ac88-d1655bc708b2 req-8c866678-5e60-4803-a08c-f575a304e9e5 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:23.584699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-b5140f90-3432-42e0-ac88-d1655bc708b2 req-8c866678-5e60-4803-a08c-f575a304e9e5 service nova] Creating event network-changed:381f3466-20ef-4ea9-928c-46f57ce0f0d8 for instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 on hv-cinder-83538 Jun 23 16:05:23.589943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-b5140f90-3432-42e0-ac88-d1655bc708b2 req-8c866678-5e60-4803-a08c-f575a304e9e5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065338 Jun 23 16:05:23.590893 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 271/533] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:05:23.911788 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c70c45a6-c523-4e35-92c3-0d0341233ca5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:23.912842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c70c45a6-c523-4e35-92c3-0d0341233ca5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:23.920725 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c70c45a6-c523-4e35-92c3-0d0341233ca5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:23.921600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c70c45a6-c523-4e35-92c3-0d0341233ca5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:23.922597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c70c45a6-c523-4e35-92c3-0d0341233ca5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:23.923354 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c70c45a6-c523-4e35-92c3-0d0341233ca5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:24.141556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c70c45a6-c523-4e35-92c3-0d0341233ca5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:24.149010 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c70c45a6-c523-4e35-92c3-0d0341233ca5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.240908 Jun 23 16:05:24.150227 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 263/534] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:23 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:24.340766 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1050a1e9-b845-4625-a4c0-e0f097aaa0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:24.342088 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1050a1e9-b845-4625-a4c0-e0f097aaa0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:24.349404 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1050a1e9-b845-4625-a4c0-e0f097aaa0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:24.349851 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1050a1e9-b845-4625-a4c0-e0f097aaa0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:24.350774 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1050a1e9-b845-4625-a4c0-e0f097aaa0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:24.351379 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1050a1e9-b845-4625-a4c0-e0f097aaa0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:24.456756 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-565d3c47-1453-4441-8fd7-b36e53659cc4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:24.461155 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-565d3c47-1453-4441-8fd7-b36e53659cc4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:24.474328 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-565d3c47-1453-4441-8fd7-b36e53659cc4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:24.474797 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-565d3c47-1453-4441-8fd7-b36e53659cc4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:24.475621 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-565d3c47-1453-4441-8fd7-b36e53659cc4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:24.476054 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-565d3c47-1453-4441-8fd7-b36e53659cc4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:24.491432 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1050a1e9-b845-4625-a4c0-e0f097aaa0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:24.501403 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1050a1e9-b845-4625-a4c0-e0f097aaa0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:24.502948 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1050a1e9-b845-4625-a4c0-e0f097aaa0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:24.504196 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1050a1e9-b845-4625-a4c0-e0f097aaa0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.168159 Jun 23 16:05:24.504718 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 272/535] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:24 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:24.637862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-565d3c47-1453-4441-8fd7-b36e53659cc4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:24.645601 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-565d3c47-1453-4441-8fd7-b36e53659cc4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.199315 Jun 23 16:05:24.646180 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 264/536] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:24 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:25.166423 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e96920b3-1e28-4f99-a5d2-606c01a2bc8c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:25.167064 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e96920b3-1e28-4f99-a5d2-606c01a2bc8c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:25.173755 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e96920b3-1e28-4f99-a5d2-606c01a2bc8c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:25.174195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e96920b3-1e28-4f99-a5d2-606c01a2bc8c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:25.174982 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e96920b3-1e28-4f99-a5d2-606c01a2bc8c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:25.175414 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e96920b3-1e28-4f99-a5d2-606c01a2bc8c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:25.307796 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e96920b3-1e28-4f99-a5d2-606c01a2bc8c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:25.317010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e96920b3-1e28-4f99-a5d2-606c01a2bc8c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.154392 Jun 23 16:05:25.317588 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 273/537] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:25 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:25.522010 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8386a58a-3de6-4428-ab1e-117897c4d349 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:25.522658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8386a58a-3de6-4428-ab1e-117897c4d349 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:25.530183 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8386a58a-3de6-4428-ab1e-117897c4d349 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:25.530630 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8386a58a-3de6-4428-ab1e-117897c4d349 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:25.531470 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8386a58a-3de6-4428-ab1e-117897c4d349 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:25.531943 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8386a58a-3de6-4428-ab1e-117897c4d349 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:25.662908 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-75931112-527c-454a-9010-af4c0f7a6a41 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:25.663623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-75931112-527c-454a-9010-af4c0f7a6a41 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:25.670440 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-75931112-527c-454a-9010-af4c0f7a6a41 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:25.670987 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-75931112-527c-454a-9010-af4c0f7a6a41 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:25.671560 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8386a58a-3de6-4428-ab1e-117897c4d349 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:25.671895 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-75931112-527c-454a-9010-af4c0f7a6a41 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:25.672403 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-75931112-527c-454a-9010-af4c0f7a6a41 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:25.681897 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8386a58a-3de6-4428-ab1e-117897c4d349 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:25.684297 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8386a58a-3de6-4428-ab1e-117897c4d349 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:25.685476 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8386a58a-3de6-4428-ab1e-117897c4d349 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.167717 Jun 23 16:05:25.686037 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 265/538] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:25 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:25.826425 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-75931112-527c-454a-9010-af4c0f7a6a41 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:25.835649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-75931112-527c-454a-9010-af4c0f7a6a41 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.176776 Jun 23 16:05:25.836235 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 274/539] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:25 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:05:26.169673 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-2d8426a2-d0b1-457c-bc3b-eb4c8f8a5c66 req-3102e2e9-67a5-444d-88ab-fd2640cb5a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1", "name": "network-vif-plugged", "status": "completed", "tag": "ee05b6a8-bcfd-4af9-baec-36320570c58e"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:26.175962 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:26.194796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2d8426a2-d0b1-457c-bc3b-eb4c8f8a5c66 req-3102e2e9-67a5-444d-88ab-fd2640cb5a2b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:26.194796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2d8426a2-d0b1-457c-bc3b-eb4c8f8a5c66 req-3102e2e9-67a5-444d-88ab-fd2640cb5a2b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:26.197761 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:26.208772 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-2d8426a2-d0b1-457c-bc3b-eb4c8f8a5c66 req-3102e2e9-67a5-444d-88ab-fd2640cb5a2b service nova] Creating event network-vif-plugged:ee05b6a8-bcfd-4af9-baec-36320570c58e for instance af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 on hv-cinder-83538 Jun 23 16:05:26.214857 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-2d8426a2-d0b1-457c-bc3b-eb4c8f8a5c66 req-3102e2e9-67a5-444d-88ab-fd2640cb5a2b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050700 Jun 23 16:05:26.216451 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 266/540] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:05:26.334875 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cf1271b7-d72d-404d-92ae-8ed7eabc940a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:26.335821 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cf1271b7-d72d-404d-92ae-8ed7eabc940a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:26.343169 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf1271b7-d72d-404d-92ae-8ed7eabc940a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:26.343641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf1271b7-d72d-404d-92ae-8ed7eabc940a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:26.344500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf1271b7-d72d-404d-92ae-8ed7eabc940a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:26.344995 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cf1271b7-d72d-404d-92ae-8ed7eabc940a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:26.481882 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-cf1271b7-d72d-404d-92ae-8ed7eabc940a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:26.497416 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cf1271b7-d72d-404d-92ae-8ed7eabc940a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.164026 Jun 23 16:05:26.499449 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 275/541] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:26 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:26.705269 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3fc4adbb-fef7-4a15-a28b-f46e23dcc7db tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:26.705879 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3fc4adbb-fef7-4a15-a28b-f46e23dcc7db tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:26.712841 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3fc4adbb-fef7-4a15-a28b-f46e23dcc7db tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:26.713366 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3fc4adbb-fef7-4a15-a28b-f46e23dcc7db tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:26.714239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3fc4adbb-fef7-4a15-a28b-f46e23dcc7db tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:26.715390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3fc4adbb-fef7-4a15-a28b-f46e23dcc7db tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:26.854214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-51b61d87-aa29-4050-8901-84fcee0769ed tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:26.854875 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-51b61d87-aa29-4050-8901-84fcee0769ed tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:26.862541 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51b61d87-aa29-4050-8901-84fcee0769ed tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:26.863233 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51b61d87-aa29-4050-8901-84fcee0769ed tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:26.863509 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3fc4adbb-fef7-4a15-a28b-f46e23dcc7db tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:26.864022 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51b61d87-aa29-4050-8901-84fcee0769ed tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:26.864463 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51b61d87-aa29-4050-8901-84fcee0769ed tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:26.875311 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3fc4adbb-fef7-4a15-a28b-f46e23dcc7db tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:26.877272 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3fc4adbb-fef7-4a15-a28b-f46e23dcc7db tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:26.878769 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3fc4adbb-fef7-4a15-a28b-f46e23dcc7db tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.177972 Jun 23 16:05:26.883945 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 267/542] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:26 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:27.023882 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-51b61d87-aa29-4050-8901-84fcee0769ed tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:27.034350 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-51b61d87-aa29-4050-8901-84fcee0769ed tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.184836 Jun 23 16:05:27.034972 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 276/543] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:26 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:05:27.516165 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cdb7b26f-d607-4d5f-af4e-9e1eed5bcf6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:27.516973 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cdb7b26f-d607-4d5f-af4e-9e1eed5bcf6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:27.523227 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cdb7b26f-d607-4d5f-af4e-9e1eed5bcf6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:27.523934 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cdb7b26f-d607-4d5f-af4e-9e1eed5bcf6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:27.525244 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cdb7b26f-d607-4d5f-af4e-9e1eed5bcf6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:27.525779 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cdb7b26f-d607-4d5f-af4e-9e1eed5bcf6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:27.668301 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cdb7b26f-d607-4d5f-af4e-9e1eed5bcf6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:27.675793 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cdb7b26f-d607-4d5f-af4e-9e1eed5bcf6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.163997 Jun 23 16:05:27.676359 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 268/544] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:27 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:27.903276 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-62455636-29d4-4615-b48d-a757f800d5d1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:27.904491 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-62455636-29d4-4615-b48d-a757f800d5d1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:27.916338 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-62455636-29d4-4615-b48d-a757f800d5d1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:27.916797 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-62455636-29d4-4615-b48d-a757f800d5d1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:27.919906 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-62455636-29d4-4615-b48d-a757f800d5d1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:27.920502 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-62455636-29d4-4615-b48d-a757f800d5d1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:28.052448 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9954a3b8-c961-4c09-ba65-e9269aed320d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:28.057195 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9954a3b8-c961-4c09-ba65-e9269aed320d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:28.066306 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9954a3b8-c961-4c09-ba65-e9269aed320d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:28.068964 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9954a3b8-c961-4c09-ba65-e9269aed320d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:28.074396 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9954a3b8-c961-4c09-ba65-e9269aed320d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:28.074930 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9954a3b8-c961-4c09-ba65-e9269aed320d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:28.256046 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-62455636-29d4-4615-b48d-a757f800d5d1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:28.266683 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-62455636-29d4-4615-b48d-a757f800d5d1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:28.267868 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-62455636-29d4-4615-b48d-a757f800d5d1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:28.279639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-62455636-29d4-4615-b48d-a757f800d5d1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.381557 Jun 23 16:05:28.280552 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 277/545] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:27 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:28.371572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9954a3b8-c961-4c09-ba65-e9269aed320d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:28.380727 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9954a3b8-c961-4c09-ba65-e9269aed320d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.333305 Jun 23 16:05:28.382902 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 269/546] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:28 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:28.694296 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-63ae2e46-0a41-47f7-a9cb-13d796f755e4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:28.695047 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-63ae2e46-0a41-47f7-a9cb-13d796f755e4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:28.698115 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:28.705949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-63ae2e46-0a41-47f7-a9cb-13d796f755e4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:28.711539 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-63ae2e46-0a41-47f7-a9cb-13d796f755e4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:28.712459 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-63ae2e46-0a41-47f7-a9cb-13d796f755e4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:28.712970 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-63ae2e46-0a41-47f7-a9cb-13d796f755e4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:28.861019 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-63ae2e46-0a41-47f7-a9cb-13d796f755e4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:28.868531 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-63ae2e46-0a41-47f7-a9cb-13d796f755e4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.179109 Jun 23 16:05:28.869492 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 278/547] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:28 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:29.298953 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-56dbd8d8-b59e-4975-9a73-3e924fcde0bc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:29.299495 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-56dbd8d8-b59e-4975-9a73-3e924fcde0bc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:29.305805 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-56dbd8d8-b59e-4975-9a73-3e924fcde0bc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:29.306476 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-56dbd8d8-b59e-4975-9a73-3e924fcde0bc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:29.307493 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-56dbd8d8-b59e-4975-9a73-3e924fcde0bc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:29.307922 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-56dbd8d8-b59e-4975-9a73-3e924fcde0bc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:29.400589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fd91012b-70d3-4ca5-8ebb-d09b71d8f4d7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:29.401458 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fd91012b-70d3-4ca5-8ebb-d09b71d8f4d7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:29.409748 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd91012b-70d3-4ca5-8ebb-d09b71d8f4d7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:29.410191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd91012b-70d3-4ca5-8ebb-d09b71d8f4d7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:29.410984 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd91012b-70d3-4ca5-8ebb-d09b71d8f4d7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:29.411418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fd91012b-70d3-4ca5-8ebb-d09b71d8f4d7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:29.459798 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-56dbd8d8-b59e-4975-9a73-3e924fcde0bc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:29.476591 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-56dbd8d8-b59e-4975-9a73-3e924fcde0bc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:29.479413 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-56dbd8d8-b59e-4975-9a73-3e924fcde0bc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:29.481187 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-56dbd8d8-b59e-4975-9a73-3e924fcde0bc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.186329 Jun 23 16:05:29.482111 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 270/548] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:29 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:29.566526 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fd91012b-70d3-4ca5-8ebb-d09b71d8f4d7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:29.579517 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fd91012b-70d3-4ca5-8ebb-d09b71d8f4d7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.180704 Jun 23 16:05:29.580675 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 279/549] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:29 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:05:29.892525 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d5fc5fb7-f054-4544-b0e4-7b0339110967 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:29.893465 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d5fc5fb7-f054-4544-b0e4-7b0339110967 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:29.900170 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5fc5fb7-f054-4544-b0e4-7b0339110967 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:29.900704 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5fc5fb7-f054-4544-b0e4-7b0339110967 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:29.901475 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5fc5fb7-f054-4544-b0e4-7b0339110967 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:29.901933 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5fc5fb7-f054-4544-b0e4-7b0339110967 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:30.038484 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d5fc5fb7-f054-4544-b0e4-7b0339110967 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:30.046111 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d5fc5fb7-f054-4544-b0e4-7b0339110967 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.158425 Jun 23 16:05:30.046673 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 271/550] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:29 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:30.499993 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-825a5aa9-0741-482f-9221-f8802d97ceb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:30.500701 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-825a5aa9-0741-482f-9221-f8802d97ceb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:30.509467 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-825a5aa9-0741-482f-9221-f8802d97ceb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:30.509929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-825a5aa9-0741-482f-9221-f8802d97ceb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:30.510762 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-825a5aa9-0741-482f-9221-f8802d97ceb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:30.511662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-825a5aa9-0741-482f-9221-f8802d97ceb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:30.599072 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-de3e9e4f-f09f-44f2-a034-40466cab8928 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:30.600477 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-de3e9e4f-f09f-44f2-a034-40466cab8928 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:30.603886 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:30.604859 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=8 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:30.611404 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-de3e9e4f-f09f-44f2-a034-40466cab8928 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:30.612269 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-de3e9e4f-f09f-44f2-a034-40466cab8928 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:30.613280 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-de3e9e4f-f09f-44f2-a034-40466cab8928 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:30.613816 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-de3e9e4f-f09f-44f2-a034-40466cab8928 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:30.675149 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-825a5aa9-0741-482f-9221-f8802d97ceb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:30.685867 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-825a5aa9-0741-482f-9221-f8802d97ceb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:30.687671 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-825a5aa9-0741-482f-9221-f8802d97ceb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:30.688971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-825a5aa9-0741-482f-9221-f8802d97ceb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.193641 Jun 23 16:05:30.690010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 280/551] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:30 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:30.783484 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-de3e9e4f-f09f-44f2-a034-40466cab8928 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:30.793540 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-de3e9e4f-f09f-44f2-a034-40466cab8928 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1267 microversion: 2.1 time: 0.199627 Jun 23 16:05:30.796843 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 272/552] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:30 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:30.854684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-9661fbf6-5d4f-40d1-9903-77f4fdc5f86f req-01f9e48b-a470-408d-b0d0-b49d2beca82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b18125-a7dc-4adf-8537-a1c18e79ccf7", "name": "network-vif-plugged", "status": "completed", "tag": "381f3466-20ef-4ea9-928c-46f57ce0f0d8"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:30.869763 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-9661fbf6-5d4f-40d1-9903-77f4fdc5f86f req-01f9e48b-a470-408d-b0d0-b49d2beca82a service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:30.870219 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-9661fbf6-5d4f-40d1-9903-77f4fdc5f86f req-01f9e48b-a470-408d-b0d0-b49d2beca82a service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:30.884907 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-9661fbf6-5d4f-40d1-9903-77f4fdc5f86f req-01f9e48b-a470-408d-b0d0-b49d2beca82a service nova] Creating event network-vif-plugged:381f3466-20ef-4ea9-928c-46f57ce0f0d8 for instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 on hv-cinder-83538 Jun 23 16:05:30.890902 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-9661fbf6-5d4f-40d1-9903-77f4fdc5f86f req-01f9e48b-a470-408d-b0d0-b49d2beca82a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040834 Jun 23 16:05:30.891976 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 281/553] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:05:31.062736 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-44a15fe8-fbdc-4347-a73f-f5df57cb5051 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:31.063352 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-44a15fe8-fbdc-4347-a73f-f5df57cb5051 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:31.072198 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44a15fe8-fbdc-4347-a73f-f5df57cb5051 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:31.072669 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44a15fe8-fbdc-4347-a73f-f5df57cb5051 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:31.078037 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44a15fe8-fbdc-4347-a73f-f5df57cb5051 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:31.082147 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44a15fe8-fbdc-4347-a73f-f5df57cb5051 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:31.271662 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-44a15fe8-fbdc-4347-a73f-f5df57cb5051 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:31.281562 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-44a15fe8-fbdc-4347-a73f-f5df57cb5051 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.222482 Jun 23 16:05:31.282255 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 273/554] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:31 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:31.708861 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-43ce24c0-8ea7-4fce-a85d-99d67d68ffa8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:31.709582 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-43ce24c0-8ea7-4fce-a85d-99d67d68ffa8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:31.716592 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43ce24c0-8ea7-4fce-a85d-99d67d68ffa8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:31.717399 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43ce24c0-8ea7-4fce-a85d-99d67d68ffa8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:31.717855 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43ce24c0-8ea7-4fce-a85d-99d67d68ffa8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:31.718294 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43ce24c0-8ea7-4fce-a85d-99d67d68ffa8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:31.812375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-abbfe190-d38d-4e5c-a822-e35bacf8b8b5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:31.814247 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-abbfe190-d38d-4e5c-a822-e35bacf8b8b5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:31.821190 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abbfe190-d38d-4e5c-a822-e35bacf8b8b5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:31.821636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abbfe190-d38d-4e5c-a822-e35bacf8b8b5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:31.823185 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abbfe190-d38d-4e5c-a822-e35bacf8b8b5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:31.824710 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abbfe190-d38d-4e5c-a822-e35bacf8b8b5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:31.865805 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-43ce24c0-8ea7-4fce-a85d-99d67d68ffa8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:31.875023 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-43ce24c0-8ea7-4fce-a85d-99d67d68ffa8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:31.876544 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-43ce24c0-8ea7-4fce-a85d-99d67d68ffa8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:31.877724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-43ce24c0-8ea7-4fce-a85d-99d67d68ffa8 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.173914 Jun 23 16:05:31.885202 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 282/555] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:31 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:31.965610 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-abbfe190-d38d-4e5c-a822-e35bacf8b8b5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:31.975684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-abbfe190-d38d-4e5c-a822-e35bacf8b8b5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1453 microversion: 2.1 time: 0.168316 Jun 23 16:05:31.976261 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 274/556] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:31 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:05:31.993176 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1397c478-052f-4d38-bd00-03bca9b4261c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:31.993783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1397c478-052f-4d38-bd00-03bca9b4261c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:32.000835 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1397c478-052f-4d38-bd00-03bca9b4261c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:32.001273 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1397c478-052f-4d38-bd00-03bca9b4261c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:32.002027 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1397c478-052f-4d38-bd00-03bca9b4261c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:32.002454 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1397c478-052f-4d38-bd00-03bca9b4261c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:32.146523 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-1397c478-052f-4d38-bd00-03bca9b4261c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:32.156319 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1397c478-052f-4d38-bd00-03bca9b4261c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1453 microversion: 2.1 time: 0.166827 Jun 23 16:05:32.156886 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 283/557] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:31 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:32.298658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bb57bbb5-8010-4139-b8c5-1822a3591eeb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:32.299295 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bb57bbb5-8010-4139-b8c5-1822a3591eeb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:32.306448 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb57bbb5-8010-4139-b8c5-1822a3591eeb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:32.307214 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb57bbb5-8010-4139-b8c5-1822a3591eeb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:32.308775 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb57bbb5-8010-4139-b8c5-1822a3591eeb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:32.309245 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb57bbb5-8010-4139-b8c5-1822a3591eeb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:32.484627 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bb57bbb5-8010-4139-b8c5-1822a3591eeb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:32.492600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bb57bbb5-8010-4139-b8c5-1822a3591eeb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.197729 Jun 23 16:05:32.494019 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 275/558] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:32 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:32.903466 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-46db8877-3633-4edb-acdb-af356a6bb050 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:32.904624 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-46db8877-3633-4edb-acdb-af356a6bb050 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:32.915985 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-46db8877-3633-4edb-acdb-af356a6bb050 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:32.917112 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-46db8877-3633-4edb-acdb-af356a6bb050 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:32.918829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-46db8877-3633-4edb-acdb-af356a6bb050 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:32.919829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-46db8877-3633-4edb-acdb-af356a6bb050 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:32.926956 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:33.413270 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-46db8877-3633-4edb-acdb-af356a6bb050 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:33.423440 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-46db8877-3633-4edb-acdb-af356a6bb050 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:33.427341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-46db8877-3633-4edb-acdb-af356a6bb050 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:33.429264 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-46db8877-3633-4edb-acdb-af356a6bb050 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.534474 Jun 23 16:05:33.444341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 284/559] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:32 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:33.509815 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b5558574-fea5-4a0e-a06f-8a7715423cb5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:33.511461 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b5558574-fea5-4a0e-a06f-8a7715423cb5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:33.517985 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b5558574-fea5-4a0e-a06f-8a7715423cb5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:33.518765 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b5558574-fea5-4a0e-a06f-8a7715423cb5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:33.519803 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b5558574-fea5-4a0e-a06f-8a7715423cb5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:33.520454 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b5558574-fea5-4a0e-a06f-8a7715423cb5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:33.701045 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b5558574-fea5-4a0e-a06f-8a7715423cb5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:33.708960 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b5558574-fea5-4a0e-a06f-8a7715423cb5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.203352 Jun 23 16:05:33.718409 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 276/560] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:33 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:34.449855 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c341a238-51fd-4eec-b403-25d12c11095e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:34.451156 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c341a238-51fd-4eec-b403-25d12c11095e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:34.468833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-c751ba56-9e2f-4e17-8d6a-921143fde028 req-e65059ef-4fbc-424a-9942-f3746a73fba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1", "tag": "ee05b6a8-bcfd-4af9-baec-36320570c58e"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:34.473579 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c341a238-51fd-4eec-b403-25d12c11095e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:34.475373 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c341a238-51fd-4eec-b403-25d12c11095e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:34.477666 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c341a238-51fd-4eec-b403-25d12c11095e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:34.479108 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c341a238-51fd-4eec-b403-25d12c11095e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:34.484798 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-c751ba56-9e2f-4e17-8d6a-921143fde028 req-e65059ef-4fbc-424a-9942-f3746a73fba7 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:34.485638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-c751ba56-9e2f-4e17-8d6a-921143fde028 req-e65059ef-4fbc-424a-9942-f3746a73fba7 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:34.509558 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-c751ba56-9e2f-4e17-8d6a-921143fde028 req-e65059ef-4fbc-424a-9942-f3746a73fba7 service nova] Creating event network-changed:ee05b6a8-bcfd-4af9-baec-36320570c58e for instance af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 on hv-cinder-83538 Jun 23 16:05:34.519897 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-c751ba56-9e2f-4e17-8d6a-921143fde028 req-e65059ef-4fbc-424a-9942-f3746a73fba7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055092 Jun 23 16:05:34.528971 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 277/561] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:05:34.679205 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c341a238-51fd-4eec-b403-25d12c11095e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:34.689576 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c341a238-51fd-4eec-b403-25d12c11095e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:34.691658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c341a238-51fd-4eec-b403-25d12c11095e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:34.693559 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c341a238-51fd-4eec-b403-25d12c11095e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.248834 Jun 23 16:05:34.708452 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 285/562] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:34 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:34.728236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d634b4b1-a282-41a3-8a12-95bedc33e720 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:34.729315 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d634b4b1-a282-41a3-8a12-95bedc33e720 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:34.736767 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d634b4b1-a282-41a3-8a12-95bedc33e720 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:34.737602 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d634b4b1-a282-41a3-8a12-95bedc33e720 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:34.738646 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d634b4b1-a282-41a3-8a12-95bedc33e720 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:34.739336 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d634b4b1-a282-41a3-8a12-95bedc33e720 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:34.974018 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d634b4b1-a282-41a3-8a12-95bedc33e720 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:34.992922 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d634b4b1-a282-41a3-8a12-95bedc33e720 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1368 microversion: 2.1 time: 0.270145 Jun 23 16:05:34.993603 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 278/563] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:34 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:05:35.716320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-53d4a823-4a79-41a9-91a4-934c91df6134 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:35.716904 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-53d4a823-4a79-41a9-91a4-934c91df6134 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:35.723732 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-53d4a823-4a79-41a9-91a4-934c91df6134 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:35.724182 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-53d4a823-4a79-41a9-91a4-934c91df6134 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:35.724935 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-53d4a823-4a79-41a9-91a4-934c91df6134 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:35.725352 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-53d4a823-4a79-41a9-91a4-934c91df6134 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:35.885308 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-53d4a823-4a79-41a9-91a4-934c91df6134 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:35.895569 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-53d4a823-4a79-41a9-91a4-934c91df6134 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:35.897125 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-53d4a823-4a79-41a9-91a4-934c91df6134 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:35.898309 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-53d4a823-4a79-41a9-91a4-934c91df6134 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1739 microversion: 2.20 time: 0.186455 Jun 23 16:05:35.899565 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 286/564] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:35 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:36.011552 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c221f009-7355-4ab0-8861-52a89e8621e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:36.013484 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c221f009-7355-4ab0-8861-52a89e8621e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:36.019725 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c221f009-7355-4ab0-8861-52a89e8621e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:36.020312 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c221f009-7355-4ab0-8861-52a89e8621e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:36.022601 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c221f009-7355-4ab0-8861-52a89e8621e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:36.023056 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c221f009-7355-4ab0-8861-52a89e8621e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:36.180085 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c221f009-7355-4ab0-8861-52a89e8621e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:36.188097 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c221f009-7355-4ab0-8861-52a89e8621e2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1557 microversion: 2.1 time: 0.181025 Jun 23 16:05:36.188656 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 279/565] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:05:36 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1557 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:05:36.205065 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5cd16383-8f13-4db4-8da9-18bd3f68c260 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:36.205551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5cd16383-8f13-4db4-8da9-18bd3f68c260 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:36.212351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cd16383-8f13-4db4-8da9-18bd3f68c260 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:36.212837 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cd16383-8f13-4db4-8da9-18bd3f68c260 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:36.213589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cd16383-8f13-4db4-8da9-18bd3f68c260 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:36.214019 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5cd16383-8f13-4db4-8da9-18bd3f68c260 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:36.294943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5cd16383-8f13-4db4-8da9-18bd3f68c260 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093858 Jun 23 16:05:36.295762 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 287/566] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 23 16:05:36 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:05:36.919981 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4439de64-fba6-43f5-881a-2350fcd857d6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:36.920752 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4439de64-fba6-43f5-881a-2350fcd857d6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:36.927597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4439de64-fba6-43f5-881a-2350fcd857d6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:36.928076 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4439de64-fba6-43f5-881a-2350fcd857d6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:36.928966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4439de64-fba6-43f5-881a-2350fcd857d6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:36.929405 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4439de64-fba6-43f5-881a-2350fcd857d6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:37.156983 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4439de64-fba6-43f5-881a-2350fcd857d6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:37.165770 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4439de64-fba6-43f5-881a-2350fcd857d6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:37.168150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4439de64-fba6-43f5-881a-2350fcd857d6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:37.169646 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4439de64-fba6-43f5-881a-2350fcd857d6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1721 microversion: 2.20 time: 0.254523 Jun 23 16:05:37.170497 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 280/567] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:36 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:05:37.294603 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-edd84528-e84f-4779-900e-5dfbcc3cfbf0 req-3789d1f9-2842-4d39-b428-80c4cee6d385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b18125-a7dc-4adf-8537-a1c18e79ccf7", "tag": "381f3466-20ef-4ea9-928c-46f57ce0f0d8"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:37.302963 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-edd84528-e84f-4779-900e-5dfbcc3cfbf0 req-3789d1f9-2842-4d39-b428-80c4cee6d385 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:37.303411 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-edd84528-e84f-4779-900e-5dfbcc3cfbf0 req-3789d1f9-2842-4d39-b428-80c4cee6d385 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:37.317005 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-edd84528-e84f-4779-900e-5dfbcc3cfbf0 req-3789d1f9-2842-4d39-b428-80c4cee6d385 service nova] Creating event network-changed:381f3466-20ef-4ea9-928c-46f57ce0f0d8 for instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 on hv-cinder-83538 Jun 23 16:05:37.322337 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-edd84528-e84f-4779-900e-5dfbcc3cfbf0 req-3789d1f9-2842-4d39-b428-80c4cee6d385 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031688 Jun 23 16:05:37.323013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 288/568] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:05:38.188959 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3f4c8dee-6d07-44e5-90cd-92aa45c55da4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:38.189591 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3f4c8dee-6d07-44e5-90cd-92aa45c55da4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:38.195835 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f4c8dee-6d07-44e5-90cd-92aa45c55da4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:38.196275 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f4c8dee-6d07-44e5-90cd-92aa45c55da4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:38.197033 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f4c8dee-6d07-44e5-90cd-92aa45c55da4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:38.197466 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f4c8dee-6d07-44e5-90cd-92aa45c55da4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:38.334222 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3f4c8dee-6d07-44e5-90cd-92aa45c55da4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:38.342922 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3f4c8dee-6d07-44e5-90cd-92aa45c55da4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:38.344425 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3f4c8dee-6d07-44e5-90cd-92aa45c55da4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:38.345576 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3f4c8dee-6d07-44e5-90cd-92aa45c55da4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1721 microversion: 2.20 time: 0.160561 Jun 23 16:05:38.346130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 281/569] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:38 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:39.366760 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5a6270b7-0cb6-4cf9-be13-08ad09004a2c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:39.367500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5a6270b7-0cb6-4cf9-be13-08ad09004a2c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:39.374397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a6270b7-0cb6-4cf9-be13-08ad09004a2c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:39.375023 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a6270b7-0cb6-4cf9-be13-08ad09004a2c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:39.375822 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a6270b7-0cb6-4cf9-be13-08ad09004a2c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:39.376387 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5a6270b7-0cb6-4cf9-be13-08ad09004a2c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:39.537850 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5a6270b7-0cb6-4cf9-be13-08ad09004a2c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:39.547607 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5a6270b7-0cb6-4cf9-be13-08ad09004a2c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:39.549267 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5a6270b7-0cb6-4cf9-be13-08ad09004a2c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:39.550674 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5a6270b7-0cb6-4cf9-be13-08ad09004a2c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1721 microversion: 2.20 time: 0.188839 Jun 23 16:05:39.551251 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 289/570] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:39 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:40.569729 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c5565cab-8ba3-496b-803d-4a9d6c852d9c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:40.570341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c5565cab-8ba3-496b-803d-4a9d6c852d9c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:40.577207 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c5565cab-8ba3-496b-803d-4a9d6c852d9c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:40.577682 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c5565cab-8ba3-496b-803d-4a9d6c852d9c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:40.578717 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c5565cab-8ba3-496b-803d-4a9d6c852d9c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:40.578910 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c5565cab-8ba3-496b-803d-4a9d6c852d9c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:40.706590 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c5565cab-8ba3-496b-803d-4a9d6c852d9c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:40.714880 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c5565cab-8ba3-496b-803d-4a9d6c852d9c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:40.716440 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c5565cab-8ba3-496b-803d-4a9d6c852d9c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:40.717617 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c5565cab-8ba3-496b-803d-4a9d6c852d9c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1664 microversion: 2.20 time: 0.151843 Jun 23 16:05:40.718186 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 282/571] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:40 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:40.735903 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b101fdb6-08a2-40a0-a4b0-ccc2bf8a1df5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8024fb95-2cc0-417d-9212-7aab743dc013"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:40.736972 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b101fdb6-08a2-40a0-a4b0-ccc2bf8a1df5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:40.743759 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b101fdb6-08a2-40a0-a4b0-ccc2bf8a1df5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:40.744208 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b101fdb6-08a2-40a0-a4b0-ccc2bf8a1df5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:40.744982 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b101fdb6-08a2-40a0-a4b0-ccc2bf8a1df5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:40.745924 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b101fdb6-08a2-40a0-a4b0-ccc2bf8a1df5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:40.768468 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-25e8c0ab-af07-4e27-92fd-04838e4a6fb2 req-95aaa8a7-9271-4ff7-9d47-64f92634b558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14021a2e-8af8-4292-996e-ea87ff7752e0", "name": "network-vif-unplugged", "status": "completed", "tag": "15db635b-5851-4528-8f58-f9ba091f51a6"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:40.777923 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-25e8c0ab-af07-4e27-92fd-04838e4a6fb2 req-95aaa8a7-9271-4ff7-9d47-64f92634b558 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:40.778651 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-25e8c0ab-af07-4e27-92fd-04838e4a6fb2 req-95aaa8a7-9271-4ff7-9d47-64f92634b558 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:40.793671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.compute.server_external_events [req-25e8c0ab-af07-4e27-92fd-04838e4a6fb2 req-95aaa8a7-9271-4ff7-9d47-64f92634b558 service nova] Unable to find a host for instance 14021a2e-8af8-4292-996e-ea87ff7752e0. Dropping event network-vif-unplugged {{(pid=117891) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 16:05:40.794731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-25e8c0ab-af07-4e27-92fd-04838e4a6fb2 req-95aaa8a7-9271-4ff7-9d47-64f92634b558 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030007 Jun 23 16:05:40.795542 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 283/572] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 23 16:05:41.032755 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b101fdb6-08a2-40a0-a4b0-ccc2bf8a1df5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "POST /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301154 Jun 23 16:05:41.033367 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 290/573] 10.222.0.46 () {62 vars in 1363 bytes} [Thu Jun 23 16:05:40 2022] POST /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 16:05:41.146570 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ad00c2b7-1a38-4dbc-9d81-ff4eb07671d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:05:41.147158 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ad00c2b7-1a38-4dbc-9d81-ff4eb07671d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:41.153324 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad00c2b7-1a38-4dbc-9d81-ff4eb07671d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:41.153759 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad00c2b7-1a38-4dbc-9d81-ff4eb07671d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:41.154498 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad00c2b7-1a38-4dbc-9d81-ff4eb07671d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:41.154948 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad00c2b7-1a38-4dbc-9d81-ff4eb07671d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:41.200691 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=100 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:41.243047 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ad00c2b7-1a38-4dbc-9d81-ff4eb07671d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "POST /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/action" status: 202 len: 0 microversion: 2.20 time: 0.100282 Jun 23 16:05:41.243676 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 284/574] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Jun 23 16:05:41 2022] POST /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:05:41.252384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2f40b732-d2cd-4a10-9b8f-92ded4743dda tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:41.253000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2f40b732-d2cd-4a10-9b8f-92ded4743dda tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:41.260465 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f40b732-d2cd-4a10-9b8f-92ded4743dda tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:41.260916 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f40b732-d2cd-4a10-9b8f-92ded4743dda tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:41.261689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f40b732-d2cd-4a10-9b8f-92ded4743dda tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:41.262127 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f40b732-d2cd-4a10-9b8f-92ded4743dda tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:41.396328 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2f40b732-d2cd-4a10-9b8f-92ded4743dda tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:41.405484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2f40b732-d2cd-4a10-9b8f-92ded4743dda tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:41.407006 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2f40b732-d2cd-4a10-9b8f-92ded4743dda tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:41.408239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2f40b732-d2cd-4a10-9b8f-92ded4743dda tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1750 microversion: 2.20 time: 0.159738 Jun 23 16:05:41.408709 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 291/575] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:41 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:42.426709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9384a750-f463-4a99-b797-e804573acb12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:42.427319 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9384a750-f463-4a99-b797-e804573acb12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:42.433882 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9384a750-f463-4a99-b797-e804573acb12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:42.434329 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9384a750-f463-4a99-b797-e804573acb12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:42.435128 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9384a750-f463-4a99-b797-e804573acb12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:42.435565 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9384a750-f463-4a99-b797-e804573acb12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:42.567022 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9384a750-f463-4a99-b797-e804573acb12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:42.575490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9384a750-f463-4a99-b797-e804573acb12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:42.576986 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9384a750-f463-4a99-b797-e804573acb12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:42.578151 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9384a750-f463-4a99-b797-e804573acb12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1752 microversion: 2.20 time: 0.155473 Jun 23 16:05:42.578732 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 285/576] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:42 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:43.597977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-861f0825-c387-4646-ba03-b048a39ab4ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:43.597977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-861f0825-c387-4646-ba03-b048a39ab4ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:43.600554 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:43.605993 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-861f0825-c387-4646-ba03-b048a39ab4ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:43.606435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-861f0825-c387-4646-ba03-b048a39ab4ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:43.607222 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-861f0825-c387-4646-ba03-b048a39ab4ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:43.607648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-861f0825-c387-4646-ba03-b048a39ab4ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:43.823181 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-861f0825-c387-4646-ba03-b048a39ab4ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:43.832922 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-861f0825-c387-4646-ba03-b048a39ab4ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:43.834458 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-861f0825-c387-4646-ba03-b048a39ab4ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:43.835712 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-861f0825-c387-4646-ba03-b048a39ab4ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.242839 Jun 23 16:05:43.836288 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 292/577] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:43 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:44.856132 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5041198c-a4a7-4aba-a39e-2298dd93b4f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:44.856737 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5041198c-a4a7-4aba-a39e-2298dd93b4f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:44.863673 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5041198c-a4a7-4aba-a39e-2298dd93b4f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:44.864252 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5041198c-a4a7-4aba-a39e-2298dd93b4f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:44.865127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5041198c-a4a7-4aba-a39e-2298dd93b4f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:44.865737 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5041198c-a4a7-4aba-a39e-2298dd93b4f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:45.023576 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5041198c-a4a7-4aba-a39e-2298dd93b4f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:45.040024 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5041198c-a4a7-4aba-a39e-2298dd93b4f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:45.043001 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5041198c-a4a7-4aba-a39e-2298dd93b4f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:45.044287 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5041198c-a4a7-4aba-a39e-2298dd93b4f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.192109 Jun 23 16:05:45.045001 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 286/578] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:44 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:05:46.069449 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6730d1f8-c3f2-49e0-b8b4-b61327e4df45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:46.070268 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6730d1f8-c3f2-49e0-b8b4-b61327e4df45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:46.078190 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6730d1f8-c3f2-49e0-b8b4-b61327e4df45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:46.079149 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6730d1f8-c3f2-49e0-b8b4-b61327e4df45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:46.079519 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6730d1f8-c3f2-49e0-b8b4-b61327e4df45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:46.079958 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6730d1f8-c3f2-49e0-b8b4-b61327e4df45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:46.223018 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6730d1f8-c3f2-49e0-b8b4-b61327e4df45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:46.235455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6730d1f8-c3f2-49e0-b8b4-b61327e4df45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:46.237003 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6730d1f8-c3f2-49e0-b8b4-b61327e4df45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:46.238259 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6730d1f8-c3f2-49e0-b8b4-b61327e4df45 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.173083 Jun 23 16:05:46.238857 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 293/579] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:46 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:05:47.257425 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-27e595c2-43eb-4ea8-a2dc-56eb98dfefb1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:47.258041 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-27e595c2-43eb-4ea8-a2dc-56eb98dfefb1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:47.266595 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27e595c2-43eb-4ea8-a2dc-56eb98dfefb1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:47.267134 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27e595c2-43eb-4ea8-a2dc-56eb98dfefb1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:47.267895 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27e595c2-43eb-4ea8-a2dc-56eb98dfefb1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:47.268320 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-27e595c2-43eb-4ea8-a2dc-56eb98dfefb1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:47.403667 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-27e595c2-43eb-4ea8-a2dc-56eb98dfefb1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:47.412251 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-27e595c2-43eb-4ea8-a2dc-56eb98dfefb1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:47.413655 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-27e595c2-43eb-4ea8-a2dc-56eb98dfefb1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:47.414836 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-27e595c2-43eb-4ea8-a2dc-56eb98dfefb1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.161287 Jun 23 16:05:47.415380 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 287/580] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:47 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:48.433053 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fbe0b681-f632-4d3f-af1e-20d80ace9356 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:48.433660 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fbe0b681-f632-4d3f-af1e-20d80ace9356 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:48.440209 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbe0b681-f632-4d3f-af1e-20d80ace9356 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:48.440658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbe0b681-f632-4d3f-af1e-20d80ace9356 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:48.441424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbe0b681-f632-4d3f-af1e-20d80ace9356 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:48.441860 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbe0b681-f632-4d3f-af1e-20d80ace9356 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:48.626674 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fbe0b681-f632-4d3f-af1e-20d80ace9356 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:48.636811 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fbe0b681-f632-4d3f-af1e-20d80ace9356 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:48.638453 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fbe0b681-f632-4d3f-af1e-20d80ace9356 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:48.639742 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fbe0b681-f632-4d3f-af1e-20d80ace9356 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.210618 Jun 23 16:05:48.640384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 294/581] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:48 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:49.658445 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-70312afe-6c6b-44f7-8f21-35a3dde67187 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:49.659120 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-70312afe-6c6b-44f7-8f21-35a3dde67187 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:49.665011 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-70312afe-6c6b-44f7-8f21-35a3dde67187 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:49.665450 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-70312afe-6c6b-44f7-8f21-35a3dde67187 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:49.666196 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-70312afe-6c6b-44f7-8f21-35a3dde67187 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:49.666621 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-70312afe-6c6b-44f7-8f21-35a3dde67187 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:49.864867 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-70312afe-6c6b-44f7-8f21-35a3dde67187 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:49.873565 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-70312afe-6c6b-44f7-8f21-35a3dde67187 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:49.875108 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-70312afe-6c6b-44f7-8f21-35a3dde67187 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:49.876280 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-70312afe-6c6b-44f7-8f21-35a3dde67187 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.221740 Jun 23 16:05:49.876867 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 288/582] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:49 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:50.895502 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0cbf5c1b-939a-4ee6-921c-e075c6b2a5b4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:50.896233 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0cbf5c1b-939a-4ee6-921c-e075c6b2a5b4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:50.905918 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cbf5c1b-939a-4ee6-921c-e075c6b2a5b4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:50.906309 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cbf5c1b-939a-4ee6-921c-e075c6b2a5b4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:50.907195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cbf5c1b-939a-4ee6-921c-e075c6b2a5b4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:50.908642 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cbf5c1b-939a-4ee6-921c-e075c6b2a5b4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:51.042395 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0cbf5c1b-939a-4ee6-921c-e075c6b2a5b4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:51.051293 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0cbf5c1b-939a-4ee6-921c-e075c6b2a5b4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:51.052852 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0cbf5c1b-939a-4ee6-921c-e075c6b2a5b4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:51.053997 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0cbf5c1b-939a-4ee6-921c-e075c6b2a5b4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.162835 Jun 23 16:05:51.054776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 295/583] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:50 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:52.072913 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fde2cd02-dc8c-4bee-8ad3-498f48c81f68 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:52.074376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fde2cd02-dc8c-4bee-8ad3-498f48c81f68 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:52.082026 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fde2cd02-dc8c-4bee-8ad3-498f48c81f68 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:52.082026 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fde2cd02-dc8c-4bee-8ad3-498f48c81f68 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:52.082026 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fde2cd02-dc8c-4bee-8ad3-498f48c81f68 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:52.082505 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fde2cd02-dc8c-4bee-8ad3-498f48c81f68 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:52.215659 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fde2cd02-dc8c-4bee-8ad3-498f48c81f68 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:52.224124 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fde2cd02-dc8c-4bee-8ad3-498f48c81f68 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:52.225898 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fde2cd02-dc8c-4bee-8ad3-498f48c81f68 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:52.227678 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fde2cd02-dc8c-4bee-8ad3-498f48c81f68 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.158354 Jun 23 16:05:52.227992 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 289/584] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:52 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:05:53.246583 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8c6f1b2b-a87d-4e51-8c4e-c8f03ec06f34 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:53.247229 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8c6f1b2b-a87d-4e51-8c4e-c8f03ec06f34 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:53.254126 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c6f1b2b-a87d-4e51-8c4e-c8f03ec06f34 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:53.254573 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c6f1b2b-a87d-4e51-8c4e-c8f03ec06f34 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:53.255375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c6f1b2b-a87d-4e51-8c4e-c8f03ec06f34 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:53.255817 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8c6f1b2b-a87d-4e51-8c4e-c8f03ec06f34 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:53.400546 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8c6f1b2b-a87d-4e51-8c4e-c8f03ec06f34 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:53.409656 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8c6f1b2b-a87d-4e51-8c4e-c8f03ec06f34 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:53.411216 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8c6f1b2b-a87d-4e51-8c4e-c8f03ec06f34 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:53.412423 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8c6f1b2b-a87d-4e51-8c4e-c8f03ec06f34 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.169852 Jun 23 16:05:53.413302 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 296/585] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:53 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:54.430778 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bcc5e9fa-5af0-441b-8dcd-085870aee439 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:54.431395 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bcc5e9fa-5af0-441b-8dcd-085870aee439 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:54.437683 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bcc5e9fa-5af0-441b-8dcd-085870aee439 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:54.438121 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bcc5e9fa-5af0-441b-8dcd-085870aee439 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:54.438918 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bcc5e9fa-5af0-441b-8dcd-085870aee439 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:54.439481 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bcc5e9fa-5af0-441b-8dcd-085870aee439 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:54.608422 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bcc5e9fa-5af0-441b-8dcd-085870aee439 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:54.618006 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bcc5e9fa-5af0-441b-8dcd-085870aee439 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:54.619184 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bcc5e9fa-5af0-441b-8dcd-085870aee439 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:54.620415 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bcc5e9fa-5af0-441b-8dcd-085870aee439 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.193595 Jun 23 16:05:54.620984 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 290/586] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:54 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:55.640157 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-472d651f-0eef-44f8-87ac-616fec8c9b62 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:55.641307 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-472d651f-0eef-44f8-87ac-616fec8c9b62 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:55.650335 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-472d651f-0eef-44f8-87ac-616fec8c9b62 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:55.650846 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-472d651f-0eef-44f8-87ac-616fec8c9b62 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:55.652295 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-472d651f-0eef-44f8-87ac-616fec8c9b62 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:55.652735 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-472d651f-0eef-44f8-87ac-616fec8c9b62 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:55.804649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-472d651f-0eef-44f8-87ac-616fec8c9b62 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:55.815016 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-472d651f-0eef-44f8-87ac-616fec8c9b62 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:55.817012 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-472d651f-0eef-44f8-87ac-616fec8c9b62 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:55.818346 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-472d651f-0eef-44f8-87ac-616fec8c9b62 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.183279 Jun 23 16:05:55.819168 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 297/587] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:55 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:56.841362 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-94c747d9-0458-4297-8e13-367f7f0b7111 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:56.841362 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-94c747d9-0458-4297-8e13-367f7f0b7111 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:56.846555 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=52 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:05:56.851081 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94c747d9-0458-4297-8e13-367f7f0b7111 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:56.851520 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94c747d9-0458-4297-8e13-367f7f0b7111 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:56.852532 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94c747d9-0458-4297-8e13-367f7f0b7111 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:56.852961 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94c747d9-0458-4297-8e13-367f7f0b7111 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:56.997095 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-94c747d9-0458-4297-8e13-367f7f0b7111 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:57.006004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-94c747d9-0458-4297-8e13-367f7f0b7111 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:57.007729 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-94c747d9-0458-4297-8e13-367f7f0b7111 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:57.009162 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-94c747d9-0458-4297-8e13-367f7f0b7111 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.176413 Jun 23 16:05:57.010053 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 291/588] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:56 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:58.028706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-511a7b43-e24b-44f7-8b82-21c8293bd2e2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:58.029330 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-511a7b43-e24b-44f7-8b82-21c8293bd2e2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:58.036029 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-511a7b43-e24b-44f7-8b82-21c8293bd2e2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:58.036473 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-511a7b43-e24b-44f7-8b82-21c8293bd2e2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:58.037237 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-511a7b43-e24b-44f7-8b82-21c8293bd2e2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:58.037663 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-511a7b43-e24b-44f7-8b82-21c8293bd2e2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:58.174940 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-511a7b43-e24b-44f7-8b82-21c8293bd2e2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:58.183862 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-511a7b43-e24b-44f7-8b82-21c8293bd2e2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:58.185392 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-511a7b43-e24b-44f7-8b82-21c8293bd2e2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:58.186622 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-511a7b43-e24b-44f7-8b82-21c8293bd2e2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.162701 Jun 23 16:05:58.187217 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 298/589] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:58 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:05:59.208681 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ee9d39df-4268-4b2f-9e5b-671a7f8d77a4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:05:59.209278 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ee9d39df-4268-4b2f-9e5b-671a7f8d77a4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:05:59.215627 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee9d39df-4268-4b2f-9e5b-671a7f8d77a4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:59.216073 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee9d39df-4268-4b2f-9e5b-671a7f8d77a4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:59.216840 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee9d39df-4268-4b2f-9e5b-671a7f8d77a4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:05:59.217288 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee9d39df-4268-4b2f-9e5b-671a7f8d77a4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:05:59.367438 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ee9d39df-4268-4b2f-9e5b-671a7f8d77a4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:59.376031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ee9d39df-4268-4b2f-9e5b-671a7f8d77a4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:59.377535 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ee9d39df-4268-4b2f-9e5b-671a7f8d77a4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:05:59.378710 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ee9d39df-4268-4b2f-9e5b-671a7f8d77a4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.176196 Jun 23 16:05:59.379285 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 292/590] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:05:59 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:00.397504 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4c37b1d1-c903-4575-a7e9-a78d89dee6fa tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:00.398125 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4c37b1d1-c903-4575-a7e9-a78d89dee6fa tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:00.405283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c37b1d1-c903-4575-a7e9-a78d89dee6fa tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:00.405728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c37b1d1-c903-4575-a7e9-a78d89dee6fa tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:00.406538 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c37b1d1-c903-4575-a7e9-a78d89dee6fa tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:00.406980 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c37b1d1-c903-4575-a7e9-a78d89dee6fa tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:00.409966 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:00.546991 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4c37b1d1-c903-4575-a7e9-a78d89dee6fa tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:00.555880 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4c37b1d1-c903-4575-a7e9-a78d89dee6fa tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:00.558143 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4c37b1d1-c903-4575-a7e9-a78d89dee6fa tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:00.559472 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4c37b1d1-c903-4575-a7e9-a78d89dee6fa tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.166023 Jun 23 16:06:00.560040 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 299/591] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:00 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:01.578669 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f996a6eb-61a2-4b02-b151-f799ca18aeac tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:01.579094 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f996a6eb-61a2-4b02-b151-f799ca18aeac tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:01.585202 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f996a6eb-61a2-4b02-b151-f799ca18aeac tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:01.585645 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f996a6eb-61a2-4b02-b151-f799ca18aeac tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:01.586412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f996a6eb-61a2-4b02-b151-f799ca18aeac tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:01.586872 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f996a6eb-61a2-4b02-b151-f799ca18aeac tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:01.716993 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f996a6eb-61a2-4b02-b151-f799ca18aeac tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:01.725536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f996a6eb-61a2-4b02-b151-f799ca18aeac tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:01.727058 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f996a6eb-61a2-4b02-b151-f799ca18aeac tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:01.728217 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f996a6eb-61a2-4b02-b151-f799ca18aeac tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.153873 Jun 23 16:06:01.728770 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 293/592] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:01 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:02.851990 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-37f5a679-7316-46db-86fe-5029b22f422e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:02.852692 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-37f5a679-7316-46db-86fe-5029b22f422e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:02.859535 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-37f5a679-7316-46db-86fe-5029b22f422e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:02.860119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-37f5a679-7316-46db-86fe-5029b22f422e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:02.860957 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-37f5a679-7316-46db-86fe-5029b22f422e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:02.861465 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-37f5a679-7316-46db-86fe-5029b22f422e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:03.282862 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-37f5a679-7316-46db-86fe-5029b22f422e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:03.291591 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-37f5a679-7316-46db-86fe-5029b22f422e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:03.293103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-37f5a679-7316-46db-86fe-5029b22f422e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:03.294269 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-37f5a679-7316-46db-86fe-5029b22f422e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.551268 Jun 23 16:06:03.294849 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 300/593] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:02 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:04.312336 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b683cfb8-7bab-4be3-a163-4bb330bf40d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:04.313008 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b683cfb8-7bab-4be3-a163-4bb330bf40d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:04.319894 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b683cfb8-7bab-4be3-a163-4bb330bf40d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:04.320330 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b683cfb8-7bab-4be3-a163-4bb330bf40d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:04.321184 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b683cfb8-7bab-4be3-a163-4bb330bf40d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:04.321739 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b683cfb8-7bab-4be3-a163-4bb330bf40d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:04.450669 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b683cfb8-7bab-4be3-a163-4bb330bf40d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:04.459181 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b683cfb8-7bab-4be3-a163-4bb330bf40d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:04.460686 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b683cfb8-7bab-4be3-a163-4bb330bf40d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:04.461851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b683cfb8-7bab-4be3-a163-4bb330bf40d7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.153412 Jun 23 16:06:04.462407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 294/594] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:04 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:05.481342 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c4c30b34-66ae-4ea7-b55a-3de81fcccd71 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:05.481861 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c4c30b34-66ae-4ea7-b55a-3de81fcccd71 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:05.488354 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4c30b34-66ae-4ea7-b55a-3de81fcccd71 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:05.488805 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4c30b34-66ae-4ea7-b55a-3de81fcccd71 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:05.489569 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4c30b34-66ae-4ea7-b55a-3de81fcccd71 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:05.490009 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c4c30b34-66ae-4ea7-b55a-3de81fcccd71 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:05.619063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c4c30b34-66ae-4ea7-b55a-3de81fcccd71 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:05.630311 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c4c30b34-66ae-4ea7-b55a-3de81fcccd71 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:05.631846 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c4c30b34-66ae-4ea7-b55a-3de81fcccd71 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:05.633003 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c4c30b34-66ae-4ea7-b55a-3de81fcccd71 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.156248 Jun 23 16:06:05.633576 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 301/595] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:05 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:06.651530 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-322ce931-7d7f-4d61-a2ac-b475c8f67e76 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:06.652129 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-322ce931-7d7f-4d61-a2ac-b475c8f67e76 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:06.658029 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-322ce931-7d7f-4d61-a2ac-b475c8f67e76 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:06.658463 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-322ce931-7d7f-4d61-a2ac-b475c8f67e76 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:06.659244 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-322ce931-7d7f-4d61-a2ac-b475c8f67e76 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:06.659667 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-322ce931-7d7f-4d61-a2ac-b475c8f67e76 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:06.796597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-322ce931-7d7f-4d61-a2ac-b475c8f67e76 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:06.805567 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-322ce931-7d7f-4d61-a2ac-b475c8f67e76 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:06.807673 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-322ce931-7d7f-4d61-a2ac-b475c8f67e76 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:06.808820 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-322ce931-7d7f-4d61-a2ac-b475c8f67e76 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.161505 Jun 23 16:06:06.809363 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 295/596] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:06 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:07.828488 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a886386f-f02c-4384-a85f-68522767b716 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:07.829135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a886386f-f02c-4384-a85f-68522767b716 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:07.835914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a886386f-f02c-4384-a85f-68522767b716 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:07.836358 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a886386f-f02c-4384-a85f-68522767b716 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:07.837318 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a886386f-f02c-4384-a85f-68522767b716 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:07.837744 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a886386f-f02c-4384-a85f-68522767b716 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:07.972613 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a886386f-f02c-4384-a85f-68522767b716 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:07.981619 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a886386f-f02c-4384-a85f-68522767b716 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:07.983232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a886386f-f02c-4384-a85f-68522767b716 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:07.984386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a886386f-f02c-4384-a85f-68522767b716 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.161237 Jun 23 16:06:07.984947 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 302/597] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:07 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:09.003384 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c2e4fe3e-cf1e-41ae-9996-19b0ae40cd60 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:09.003987 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c2e4fe3e-cf1e-41ae-9996-19b0ae40cd60 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:09.010557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2e4fe3e-cf1e-41ae-9996-19b0ae40cd60 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:09.011023 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2e4fe3e-cf1e-41ae-9996-19b0ae40cd60 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:09.011817 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2e4fe3e-cf1e-41ae-9996-19b0ae40cd60 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:09.012241 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c2e4fe3e-cf1e-41ae-9996-19b0ae40cd60 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:09.141039 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c2e4fe3e-cf1e-41ae-9996-19b0ae40cd60 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:09.149590 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c2e4fe3e-cf1e-41ae-9996-19b0ae40cd60 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:09.151621 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c2e4fe3e-cf1e-41ae-9996-19b0ae40cd60 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:09.152769 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c2e4fe3e-cf1e-41ae-9996-19b0ae40cd60 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.153419 Jun 23 16:06:09.153320 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 296/598] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:08 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:10.170657 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9f2f02e1-4206-4e03-84d4-f331b665065c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:10.171286 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9f2f02e1-4206-4e03-84d4-f331b665065c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:10.177874 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f2f02e1-4206-4e03-84d4-f331b665065c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:10.178314 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f2f02e1-4206-4e03-84d4-f331b665065c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:10.179106 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f2f02e1-4206-4e03-84d4-f331b665065c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:10.179543 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9f2f02e1-4206-4e03-84d4-f331b665065c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:10.308173 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9f2f02e1-4206-4e03-84d4-f331b665065c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:10.316530 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9f2f02e1-4206-4e03-84d4-f331b665065c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:10.318031 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9f2f02e1-4206-4e03-84d4-f331b665065c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:10.319214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9f2f02e1-4206-4e03-84d4-f331b665065c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.152871 Jun 23 16:06:10.319778 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 303/599] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:10 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:11.337375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d5f8d20e-ed98-4e5b-80bb-97f3293aa212 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:11.337980 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d5f8d20e-ed98-4e5b-80bb-97f3293aa212 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:11.344544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5f8d20e-ed98-4e5b-80bb-97f3293aa212 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:11.344987 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5f8d20e-ed98-4e5b-80bb-97f3293aa212 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:11.345740 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5f8d20e-ed98-4e5b-80bb-97f3293aa212 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:11.346201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d5f8d20e-ed98-4e5b-80bb-97f3293aa212 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:11.348713 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:11.476712 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d5f8d20e-ed98-4e5b-80bb-97f3293aa212 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:11.486115 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d5f8d20e-ed98-4e5b-80bb-97f3293aa212 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:11.487685 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d5f8d20e-ed98-4e5b-80bb-97f3293aa212 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:11.488851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d5f8d20e-ed98-4e5b-80bb-97f3293aa212 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.155394 Jun 23 16:06:11.489410 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 297/600] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:11 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:12.506241 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e466730f-1fd5-47cf-b229-460964ea8926 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:12.506895 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e466730f-1fd5-47cf-b229-460964ea8926 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:12.513414 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e466730f-1fd5-47cf-b229-460964ea8926 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:12.513862 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e466730f-1fd5-47cf-b229-460964ea8926 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:12.514622 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e466730f-1fd5-47cf-b229-460964ea8926 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:12.515083 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e466730f-1fd5-47cf-b229-460964ea8926 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:12.648433 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e466730f-1fd5-47cf-b229-460964ea8926 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:12.657143 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e466730f-1fd5-47cf-b229-460964ea8926 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:12.658659 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e466730f-1fd5-47cf-b229-460964ea8926 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:12.659845 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e466730f-1fd5-47cf-b229-460964ea8926 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.157481 Jun 23 16:06:12.660406 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 304/601] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:12 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:12.912110 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-2c1864a4-8842-43e2-981c-cdbbeebe069b req-b5991dfa-6339-4a6e-a8cb-937ef5ec699a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14021a2e-8af8-4292-996e-ea87ff7752e0", "name": "network-vif-plugged", "status": "completed", "tag": "15db635b-5851-4528-8f58-f9ba091f51a6"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:06:12.921225 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2c1864a4-8842-43e2-981c-cdbbeebe069b req-b5991dfa-6339-4a6e-a8cb-937ef5ec699a service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:12.921668 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2c1864a4-8842-43e2-981c-cdbbeebe069b req-b5991dfa-6339-4a6e-a8cb-937ef5ec699a service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:12.933852 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-2c1864a4-8842-43e2-981c-cdbbeebe069b req-b5991dfa-6339-4a6e-a8cb-937ef5ec699a service nova] Creating event network-vif-plugged:15db635b-5851-4528-8f58-f9ba091f51a6 for instance 14021a2e-8af8-4292-996e-ea87ff7752e0 on hv-cinder-83538 Jun 23 16:06:12.939040 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-2c1864a4-8842-43e2-981c-cdbbeebe069b req-b5991dfa-6339-4a6e-a8cb-937ef5ec699a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030534 Jun 23 16:06:12.939918 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 298/602] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:06:13.678597 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-98ae0138-af09-4817-909a-84950b0d6685 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:13.679156 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-98ae0138-af09-4817-909a-84950b0d6685 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:13.681496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=26 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:13.687336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-98ae0138-af09-4817-909a-84950b0d6685 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:13.687778 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-98ae0138-af09-4817-909a-84950b0d6685 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:13.688539 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-98ae0138-af09-4817-909a-84950b0d6685 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:13.688970 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-98ae0138-af09-4817-909a-84950b0d6685 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:13.816375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-98ae0138-af09-4817-909a-84950b0d6685 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:13.825308 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-98ae0138-af09-4817-909a-84950b0d6685 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:13.826839 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-98ae0138-af09-4817-909a-84950b0d6685 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:13.827987 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-98ae0138-af09-4817-909a-84950b0d6685 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.153462 Jun 23 16:06:13.828543 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 305/603] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:13 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:14.846382 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3ec9678a-8219-4582-bc3e-5224f15e2924 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:14.847098 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3ec9678a-8219-4582-bc3e-5224f15e2924 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:14.853342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ec9678a-8219-4582-bc3e-5224f15e2924 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:14.853781 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ec9678a-8219-4582-bc3e-5224f15e2924 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:14.854524 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ec9678a-8219-4582-bc3e-5224f15e2924 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:14.854975 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3ec9678a-8219-4582-bc3e-5224f15e2924 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:14.984749 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3ec9678a-8219-4582-bc3e-5224f15e2924 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:14.993089 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3ec9678a-8219-4582-bc3e-5224f15e2924 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:14.994582 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3ec9678a-8219-4582-bc3e-5224f15e2924 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:14.996370 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3ec9678a-8219-4582-bc3e-5224f15e2924 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.154204 Jun 23 16:06:14.996920 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 299/604] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:14 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:16.015254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6108dc12-69ff-4084-91dd-a931e3d12335 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:16.015864 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6108dc12-69ff-4084-91dd-a931e3d12335 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:16.022449 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6108dc12-69ff-4084-91dd-a931e3d12335 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:16.022927 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6108dc12-69ff-4084-91dd-a931e3d12335 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:16.023699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6108dc12-69ff-4084-91dd-a931e3d12335 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:16.024394 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6108dc12-69ff-4084-91dd-a931e3d12335 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:16.160060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6108dc12-69ff-4084-91dd-a931e3d12335 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:16.168438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6108dc12-69ff-4084-91dd-a931e3d12335 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:16.169939 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6108dc12-69ff-4084-91dd-a931e3d12335 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:16.171144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6108dc12-69ff-4084-91dd-a931e3d12335 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.160439 Jun 23 16:06:16.171679 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 306/605] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:16 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:17.189297 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-817ec360-fd26-460d-a364-c1b411d26970 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:17.189890 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-817ec360-fd26-460d-a364-c1b411d26970 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:17.196242 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-817ec360-fd26-460d-a364-c1b411d26970 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:17.196687 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-817ec360-fd26-460d-a364-c1b411d26970 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:17.197450 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-817ec360-fd26-460d-a364-c1b411d26970 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:17.198456 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-817ec360-fd26-460d-a364-c1b411d26970 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:17.327518 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-817ec360-fd26-460d-a364-c1b411d26970 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:17.336259 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-817ec360-fd26-460d-a364-c1b411d26970 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:17.337771 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-817ec360-fd26-460d-a364-c1b411d26970 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:17.338997 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-817ec360-fd26-460d-a364-c1b411d26970 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1808 microversion: 2.20 time: 0.153759 Jun 23 16:06:17.339548 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 300/606] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:17 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:18.357824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d35e08f7-9604-4cca-b8bb-9d8cebbc5f7f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:18.358433 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d35e08f7-9604-4cca-b8bb-9d8cebbc5f7f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:18.365022 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d35e08f7-9604-4cca-b8bb-9d8cebbc5f7f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:18.365465 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d35e08f7-9604-4cca-b8bb-9d8cebbc5f7f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:18.366226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d35e08f7-9604-4cca-b8bb-9d8cebbc5f7f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:18.366659 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d35e08f7-9604-4cca-b8bb-9d8cebbc5f7f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:18.496319 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d35e08f7-9604-4cca-b8bb-9d8cebbc5f7f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:18.504824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d35e08f7-9604-4cca-b8bb-9d8cebbc5f7f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:18.506323 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d35e08f7-9604-4cca-b8bb-9d8cebbc5f7f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:18.507567 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d35e08f7-9604-4cca-b8bb-9d8cebbc5f7f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1795 microversion: 2.20 time: 0.154236 Jun 23 16:06:18.508061 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 307/607] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:06:18 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1795 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:06:22.167645 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-be911cab-3560-46d7-8dc7-3481fc142eba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9a37c63-f49b-4202-8532-27652b689bec"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:06:22.168709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-be911cab-3560-46d7-8dc7-3481fc142eba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:22.174646 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-be911cab-3560-46d7-8dc7-3481fc142eba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:22.175126 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-be911cab-3560-46d7-8dc7-3481fc142eba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:22.175884 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-be911cab-3560-46d7-8dc7-3481fc142eba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:22.176316 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-be911cab-3560-46d7-8dc7-3481fc142eba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:22.430585 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-be911cab-3560-46d7-8dc7-3481fc142eba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371097 Jun 23 16:06:22.431460 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 301/608] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:06:22 2022] POST /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments => generated 194 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:06:25.743691 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-39108b4e-bc07-4cac-8015-afaf26c152dd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:25.744245 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-39108b4e-bc07-4cac-8015-afaf26c152dd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:25.750224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39108b4e-bc07-4cac-8015-afaf26c152dd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:25.750663 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39108b4e-bc07-4cac-8015-afaf26c152dd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:25.751445 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39108b4e-bc07-4cac-8015-afaf26c152dd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:25.751898 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-39108b4e-bc07-4cac-8015-afaf26c152dd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:25.774217 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-39108b4e-bc07-4cac-8015-afaf26c152dd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/ips" status: 200 len: 146 microversion: 2.1 time: 0.034205 Jun 23 16:06:25.774788 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 308/609] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 23 16:06:25 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:06:27.877750 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-80eec5a0-7362-4556-83f9-9fac29a1432a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "674d9e54-8e99-4e69-baac-bdfc410dd46a"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:06:27.879087 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-80eec5a0-7362-4556-83f9-9fac29a1432a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:27.882457 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=22 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:27.888617 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-80eec5a0-7362-4556-83f9-9fac29a1432a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:27.889055 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-80eec5a0-7362-4556-83f9-9fac29a1432a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:27.889805 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-80eec5a0-7362-4556-83f9-9fac29a1432a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:27.890239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-80eec5a0-7362-4556-83f9-9fac29a1432a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:28.895344 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-80eec5a0-7362-4556-83f9-9fac29a1432a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.021735 Jun 23 16:06:28.895975 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 302/610] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:06:27 2022] POST /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/os-volume_attachments => generated 194 bytes in 1023 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:06:29.940349 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f3184089-c630-4621-bbc6-88079b110c01 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:06:29.941357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f3184089-c630-4621-bbc6-88079b110c01 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:29.947928 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3184089-c630-4621-bbc6-88079b110c01 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:29.948379 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3184089-c630-4621-bbc6-88079b110c01 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:29.949137 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3184089-c630-4621-bbc6-88079b110c01 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:29.949573 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f3184089-c630-4621-bbc6-88079b110c01 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:29.975168 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-f3184089-c630-4621-bbc6-88079b110c01 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lazy-loading 'flavor' on Instance uuid 649b033e-63c2-44c2-a597-4192007bb977 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:06:30.097920 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f3184089-c630-4621-bbc6-88079b110c01 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/action" status: 200 len: 32 microversion: 2.1 time: 0.161788 Jun 23 16:06:30.098414 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 309/611] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:06:29 2022] POST /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/action => generated 32 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 16:06:30.109286 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bbd26226-eb3a-4808-ae45-9d012443287b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:30.109982 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bbd26226-eb3a-4808-ae45-9d012443287b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:30.116282 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bbd26226-eb3a-4808-ae45-9d012443287b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:30.116712 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bbd26226-eb3a-4808-ae45-9d012443287b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:30.117514 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bbd26226-eb3a-4808-ae45-9d012443287b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:30.117909 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bbd26226-eb3a-4808-ae45-9d012443287b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:30.251621 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bbd26226-eb3a-4808-ae45-9d012443287b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:30.259824 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bbd26226-eb3a-4808-ae45-9d012443287b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.155822 Jun 23 16:06:30.260394 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 303/612] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:30 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:31.278991 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b1daa005-51f5-4217-a3b7-8ea0b2ad03ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:31.279703 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b1daa005-51f5-4217-a3b7-8ea0b2ad03ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:31.286073 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1daa005-51f5-4217-a3b7-8ea0b2ad03ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:31.286525 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1daa005-51f5-4217-a3b7-8ea0b2ad03ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:31.287335 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1daa005-51f5-4217-a3b7-8ea0b2ad03ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:31.287778 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b1daa005-51f5-4217-a3b7-8ea0b2ad03ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:31.290395 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:31.423010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b1daa005-51f5-4217-a3b7-8ea0b2ad03ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:31.430971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b1daa005-51f5-4217-a3b7-8ea0b2ad03ba tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.157070 Jun 23 16:06:31.431541 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 310/613] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:31 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:32.448716 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-01a12107-6e43-478e-bdea-cf0062d16542 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:32.449357 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-01a12107-6e43-478e-bdea-cf0062d16542 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:32.456496 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01a12107-6e43-478e-bdea-cf0062d16542 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:32.456943 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01a12107-6e43-478e-bdea-cf0062d16542 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:32.457702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01a12107-6e43-478e-bdea-cf0062d16542 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:32.458181 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-01a12107-6e43-478e-bdea-cf0062d16542 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:32.584981 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-01a12107-6e43-478e-bdea-cf0062d16542 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:32.593593 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-01a12107-6e43-478e-bdea-cf0062d16542 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.148757 Jun 23 16:06:32.594162 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 304/614] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:32 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:33.611334 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-949424d7-d0f3-4fcb-8f24-3f20ea154d35 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:33.611945 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-949424d7-d0f3-4fcb-8f24-3f20ea154d35 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:33.618451 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-949424d7-d0f3-4fcb-8f24-3f20ea154d35 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:33.618933 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-949424d7-d0f3-4fcb-8f24-3f20ea154d35 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:33.619694 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-949424d7-d0f3-4fcb-8f24-3f20ea154d35 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:33.620131 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-949424d7-d0f3-4fcb-8f24-3f20ea154d35 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:33.746498 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-949424d7-d0f3-4fcb-8f24-3f20ea154d35 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:33.754557 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-949424d7-d0f3-4fcb-8f24-3f20ea154d35 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.147751 Jun 23 16:06:33.755172 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 311/615] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:33 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:34.772845 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-027eef8f-1424-413d-89b2-c8a66e08e2d4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:34.773367 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-027eef8f-1424-413d-89b2-c8a66e08e2d4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:34.780087 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-027eef8f-1424-413d-89b2-c8a66e08e2d4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:34.780533 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-027eef8f-1424-413d-89b2-c8a66e08e2d4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:34.781292 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-027eef8f-1424-413d-89b2-c8a66e08e2d4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:34.781735 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-027eef8f-1424-413d-89b2-c8a66e08e2d4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:35.012150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 16:06:35.012415 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Thu Jun 23 16:06:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 (ip 10.222.0.46) !!! Jun 23 16:06:35.119252 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-027eef8f-1424-413d-89b2-c8a66e08e2d4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:35.127747 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-027eef8f-1424-413d-89b2-c8a66e08e2d4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.358824 Jun 23 16:06:35.134048 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 305/616] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:34 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:36.145714 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4b4e4d26-bc5b-4cc4-a4d4-c14b971ecc47 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:36.146247 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4b4e4d26-bc5b-4cc4-a4d4-c14b971ecc47 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:36.153220 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4b4e4d26-bc5b-4cc4-a4d4-c14b971ecc47 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:36.153664 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4b4e4d26-bc5b-4cc4-a4d4-c14b971ecc47 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:36.154425 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4b4e4d26-bc5b-4cc4-a4d4-c14b971ecc47 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:36.154892 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4b4e4d26-bc5b-4cc4-a4d4-c14b971ecc47 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:36.286620 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4b4e4d26-bc5b-4cc4-a4d4-c14b971ecc47 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:36.296759 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4b4e4d26-bc5b-4cc4-a4d4-c14b971ecc47 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.154696 Jun 23 16:06:36.297321 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 312/617] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:36 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:06:37.313044 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a1637fc5-13ed-4d1b-a40e-96381085fd43 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:37.313659 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a1637fc5-13ed-4d1b-a40e-96381085fd43 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:37.320739 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1637fc5-13ed-4d1b-a40e-96381085fd43 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:37.321193 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1637fc5-13ed-4d1b-a40e-96381085fd43 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:37.321984 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1637fc5-13ed-4d1b-a40e-96381085fd43 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:37.322420 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a1637fc5-13ed-4d1b-a40e-96381085fd43 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:37.447494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2aaa799a-69dd-4579-9bd4-1c5a7f85d508 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:06:37.454162 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2aaa799a-69dd-4579-9bd4-1c5a7f85d508 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:37.454603 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2aaa799a-69dd-4579-9bd4-1c5a7f85d508 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:37.463658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a1637fc5-13ed-4d1b-a40e-96381085fd43 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:37.472094 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a1637fc5-13ed-4d1b-a40e-96381085fd43 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.163260 Jun 23 16:06:37.472700 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 306/618] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:37 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:37.514668 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2aaa799a-69dd-4579-9bd4-1c5a7f85d508 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Going to try to stop instance {{(pid=117890) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 16:06:37.560978 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2aaa799a-69dd-4579-9bd4-1c5a7f85d508 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/action" status: 202 len: 0 microversion: 2.1 time: 0.117239 Jun 23 16:06:37.561851 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 313/619] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:06:37 2022] POST /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 16:06:37.570086 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9cefa25d-0cda-4fd0-84b8-157fdab2b84a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:37.570759 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9cefa25d-0cda-4fd0-84b8-157fdab2b84a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:37.577335 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9cefa25d-0cda-4fd0-84b8-157fdab2b84a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:37.578113 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9cefa25d-0cda-4fd0-84b8-157fdab2b84a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:37.578937 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9cefa25d-0cda-4fd0-84b8-157fdab2b84a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:37.579668 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9cefa25d-0cda-4fd0-84b8-157fdab2b84a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:37.712659 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9cefa25d-0cda-4fd0-84b8-157fdab2b84a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:37.721425 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9cefa25d-0cda-4fd0-84b8-157fdab2b84a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.155208 Jun 23 16:06:37.721990 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 307/620] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:37 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:38.489879 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f50c631b-c702-439d-9db5-8d10b9d172f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:38.490575 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f50c631b-c702-439d-9db5-8d10b9d172f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:38.497571 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f50c631b-c702-439d-9db5-8d10b9d172f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:38.497715 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f50c631b-c702-439d-9db5-8d10b9d172f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:38.499154 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f50c631b-c702-439d-9db5-8d10b9d172f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:38.499594 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f50c631b-c702-439d-9db5-8d10b9d172f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:38.632425 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f50c631b-c702-439d-9db5-8d10b9d172f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:38.640389 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f50c631b-c702-439d-9db5-8d10b9d172f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.154740 Jun 23 16:06:38.640961 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 314/621] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:38 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:38.738223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c75bb81e-7584-41ea-888d-0247e0665685 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:38.738863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c75bb81e-7584-41ea-888d-0247e0665685 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:38.745514 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c75bb81e-7584-41ea-888d-0247e0665685 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:38.745877 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c75bb81e-7584-41ea-888d-0247e0665685 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:38.746619 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c75bb81e-7584-41ea-888d-0247e0665685 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:38.747206 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c75bb81e-7584-41ea-888d-0247e0665685 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:38.873816 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c75bb81e-7584-41ea-888d-0247e0665685 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:38.881740 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c75bb81e-7584-41ea-888d-0247e0665685 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.147338 Jun 23 16:06:38.882288 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 308/622] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:38 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:39.657818 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-066f4442-f81a-4048-9bb0-5d6b30e81187 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:39.658426 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-066f4442-f81a-4048-9bb0-5d6b30e81187 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:39.664932 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-066f4442-f81a-4048-9bb0-5d6b30e81187 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:39.665380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-066f4442-f81a-4048-9bb0-5d6b30e81187 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:39.666140 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-066f4442-f81a-4048-9bb0-5d6b30e81187 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:39.666575 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-066f4442-f81a-4048-9bb0-5d6b30e81187 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:39.793257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-066f4442-f81a-4048-9bb0-5d6b30e81187 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:39.801807 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-066f4442-f81a-4048-9bb0-5d6b30e81187 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.147873 Jun 23 16:06:39.802370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 315/623] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:39 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:39.899124 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e516ad4e-d05c-4496-a524-b86c6837c166 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:39.899731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e516ad4e-d05c-4496-a524-b86c6837c166 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:39.906302 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e516ad4e-d05c-4496-a524-b86c6837c166 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:39.906764 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e516ad4e-d05c-4496-a524-b86c6837c166 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:39.907517 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e516ad4e-d05c-4496-a524-b86c6837c166 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:39.907943 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e516ad4e-d05c-4496-a524-b86c6837c166 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:40.034941 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e516ad4e-d05c-4496-a524-b86c6837c166 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:40.042831 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e516ad4e-d05c-4496-a524-b86c6837c166 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.147735 Jun 23 16:06:40.043395 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 309/624] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:39 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:40.819652 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ba13629c-5e68-4fac-9497-7e8862a72cb3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:40.820170 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ba13629c-5e68-4fac-9497-7e8862a72cb3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:40.826782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ba13629c-5e68-4fac-9497-7e8862a72cb3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:40.827248 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ba13629c-5e68-4fac-9497-7e8862a72cb3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:40.827987 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ba13629c-5e68-4fac-9497-7e8862a72cb3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:40.828419 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ba13629c-5e68-4fac-9497-7e8862a72cb3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:40.961829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ba13629c-5e68-4fac-9497-7e8862a72cb3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:40.970280 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ba13629c-5e68-4fac-9497-7e8862a72cb3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.154610 Jun 23 16:06:40.970878 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 316/625] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:40 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:06:41.059696 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-81f05a12-90c5-43c4-bdb5-26e85c91c22c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:41.060323 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-81f05a12-90c5-43c4-bdb5-26e85c91c22c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:41.066910 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-81f05a12-90c5-43c4-bdb5-26e85c91c22c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:41.067355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-81f05a12-90c5-43c4-bdb5-26e85c91c22c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:41.068111 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-81f05a12-90c5-43c4-bdb5-26e85c91c22c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:41.068548 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-81f05a12-90c5-43c4-bdb5-26e85c91c22c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:41.208075 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-81f05a12-90c5-43c4-bdb5-26e85c91c22c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:41.215960 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-81f05a12-90c5-43c4-bdb5-26e85c91c22c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.160425 Jun 23 16:06:41.217034 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 310/626] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:41 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:41.987849 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-85881aef-42d3-4b42-ba92-b9198c838428 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:41.988441 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-85881aef-42d3-4b42-ba92-b9198c838428 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:41.994993 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-85881aef-42d3-4b42-ba92-b9198c838428 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:41.995444 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-85881aef-42d3-4b42-ba92-b9198c838428 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:41.996214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-85881aef-42d3-4b42-ba92-b9198c838428 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:41.996646 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-85881aef-42d3-4b42-ba92-b9198c838428 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:42.125578 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-85881aef-42d3-4b42-ba92-b9198c838428 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:42.133536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-85881aef-42d3-4b42-ba92-b9198c838428 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.149579 Jun 23 16:06:42.134092 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 317/627] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:41 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:42.234255 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-62353fad-757d-42ef-a835-66d6fa8b4255 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:42.234899 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-62353fad-757d-42ef-a835-66d6fa8b4255 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:42.241646 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62353fad-757d-42ef-a835-66d6fa8b4255 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:42.242036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62353fad-757d-42ef-a835-66d6fa8b4255 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:42.242829 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62353fad-757d-42ef-a835-66d6fa8b4255 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:42.243267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62353fad-757d-42ef-a835-66d6fa8b4255 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:42.245772 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:42.372530 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-62353fad-757d-42ef-a835-66d6fa8b4255 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:42.381271 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-62353fad-757d-42ef-a835-66d6fa8b4255 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.150879 Jun 23 16:06:42.381839 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 311/628] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:42 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:43.151749 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-36316162-7bfe-458c-9281-024684857b72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:43.152337 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-36316162-7bfe-458c-9281-024684857b72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:43.159374 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-36316162-7bfe-458c-9281-024684857b72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:43.159819 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-36316162-7bfe-458c-9281-024684857b72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:43.160576 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-36316162-7bfe-458c-9281-024684857b72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:43.161008 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-36316162-7bfe-458c-9281-024684857b72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:43.288526 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-36316162-7bfe-458c-9281-024684857b72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:43.297099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-36316162-7bfe-458c-9281-024684857b72 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.149529 Jun 23 16:06:43.297664 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 318/629] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:43 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:43.398503 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bb0dabea-b26d-411d-970f-6f2122f2a968 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:43.399419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bb0dabea-b26d-411d-970f-6f2122f2a968 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:43.406365 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb0dabea-b26d-411d-970f-6f2122f2a968 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:43.406780 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb0dabea-b26d-411d-970f-6f2122f2a968 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:43.407534 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb0dabea-b26d-411d-970f-6f2122f2a968 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:43.407966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb0dabea-b26d-411d-970f-6f2122f2a968 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:43.542574 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bb0dabea-b26d-411d-970f-6f2122f2a968 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:43.550686 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bb0dabea-b26d-411d-970f-6f2122f2a968 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.156055 Jun 23 16:06:43.551294 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 312/630] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:43 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:06:44.314881 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0cb82ebc-5e86-4abb-b29d-047c3e5d94a8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:44.315516 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0cb82ebc-5e86-4abb-b29d-047c3e5d94a8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:44.317891 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=28 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:44.323121 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cb82ebc-5e86-4abb-b29d-047c3e5d94a8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:44.323559 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cb82ebc-5e86-4abb-b29d-047c3e5d94a8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:44.324311 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cb82ebc-5e86-4abb-b29d-047c3e5d94a8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:44.324735 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0cb82ebc-5e86-4abb-b29d-047c3e5d94a8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:44.453749 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0cb82ebc-5e86-4abb-b29d-047c3e5d94a8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:44.461675 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0cb82ebc-5e86-4abb-b29d-047c3e5d94a8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.151268 Jun 23 16:06:44.462239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 319/631] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:44 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:44.569559 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-95f9bf49-7c4f-4969-ae1d-31259df5b036 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:44.570079 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-95f9bf49-7c4f-4969-ae1d-31259df5b036 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:44.576530 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95f9bf49-7c4f-4969-ae1d-31259df5b036 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:44.576966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95f9bf49-7c4f-4969-ae1d-31259df5b036 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:44.577713 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95f9bf49-7c4f-4969-ae1d-31259df5b036 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:44.578133 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-95f9bf49-7c4f-4969-ae1d-31259df5b036 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:44.704813 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-95f9bf49-7c4f-4969-ae1d-31259df5b036 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:44.712631 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-95f9bf49-7c4f-4969-ae1d-31259df5b036 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.146993 Jun 23 16:06:44.713183 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 313/632] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:44 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:06:45.480145 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9952292f-9f85-41c5-8663-c2faa6b44f99 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:45.480784 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9952292f-9f85-41c5-8663-c2faa6b44f99 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:45.487422 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9952292f-9f85-41c5-8663-c2faa6b44f99 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:45.487876 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9952292f-9f85-41c5-8663-c2faa6b44f99 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:45.488608 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9952292f-9f85-41c5-8663-c2faa6b44f99 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:45.489031 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9952292f-9f85-41c5-8663-c2faa6b44f99 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:45.626914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9952292f-9f85-41c5-8663-c2faa6b44f99 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:45.634944 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9952292f-9f85-41c5-8663-c2faa6b44f99 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.158617 Jun 23 16:06:45.635543 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 320/633] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:45 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:06:45.729208 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-55bde652-8238-43b0-93de-f7cee7205b13 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:45.729816 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-55bde652-8238-43b0-93de-f7cee7205b13 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:45.736947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-55bde652-8238-43b0-93de-f7cee7205b13 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:45.737332 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-55bde652-8238-43b0-93de-f7cee7205b13 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:45.738081 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-55bde652-8238-43b0-93de-f7cee7205b13 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:45.738515 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-55bde652-8238-43b0-93de-f7cee7205b13 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:45.870925 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-55bde652-8238-43b0-93de-f7cee7205b13 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:45.879705 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-55bde652-8238-43b0-93de-f7cee7205b13 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.154294 Jun 23 16:06:45.880271 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 314/634] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:45 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:46.653199 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5b770986-3580-417d-bf54-2f7813f215fb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:46.654385 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5b770986-3580-417d-bf54-2f7813f215fb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:46.661373 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b770986-3580-417d-bf54-2f7813f215fb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:46.661826 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b770986-3580-417d-bf54-2f7813f215fb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:46.662591 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b770986-3580-417d-bf54-2f7813f215fb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:46.663056 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5b770986-3580-417d-bf54-2f7813f215fb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:46.792198 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5b770986-3580-417d-bf54-2f7813f215fb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:46.800143 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5b770986-3580-417d-bf54-2f7813f215fb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.150791 Jun 23 16:06:46.800702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 321/635] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:46 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:46.896282 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ee7647fb-1076-4ab0-b076-40e15cf9f8ec tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:46.896892 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ee7647fb-1076-4ab0-b076-40e15cf9f8ec tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:46.903667 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee7647fb-1076-4ab0-b076-40e15cf9f8ec tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:46.904226 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee7647fb-1076-4ab0-b076-40e15cf9f8ec tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:46.904986 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee7647fb-1076-4ab0-b076-40e15cf9f8ec tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:46.905421 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee7647fb-1076-4ab0-b076-40e15cf9f8ec tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:47.033883 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ee7647fb-1076-4ab0-b076-40e15cf9f8ec tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:47.042025 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ee7647fb-1076-4ab0-b076-40e15cf9f8ec tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.149582 Jun 23 16:06:47.042512 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 315/636] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:46 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:47.817402 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-59814f7a-111f-49a9-8e2e-66b3e2afeec4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:47.817916 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-59814f7a-111f-49a9-8e2e-66b3e2afeec4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:47.824501 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59814f7a-111f-49a9-8e2e-66b3e2afeec4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:47.824949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59814f7a-111f-49a9-8e2e-66b3e2afeec4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:47.825716 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59814f7a-111f-49a9-8e2e-66b3e2afeec4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:47.826164 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59814f7a-111f-49a9-8e2e-66b3e2afeec4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:47.955085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-59814f7a-111f-49a9-8e2e-66b3e2afeec4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:47.963014 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-59814f7a-111f-49a9-8e2e-66b3e2afeec4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.149587 Jun 23 16:06:47.963584 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 322/637] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:47 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:48.058819 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4e93a265-e7e8-44b0-95ca-558fa43d9602 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:48.059433 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4e93a265-e7e8-44b0-95ca-558fa43d9602 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:48.065952 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e93a265-e7e8-44b0-95ca-558fa43d9602 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:48.066419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e93a265-e7e8-44b0-95ca-558fa43d9602 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:48.067239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e93a265-e7e8-44b0-95ca-558fa43d9602 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:48.067731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e93a265-e7e8-44b0-95ca-558fa43d9602 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:48.193705 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4e93a265-e7e8-44b0-95ca-558fa43d9602 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:48.202099 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4e93a265-e7e8-44b0-95ca-558fa43d9602 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.146647 Jun 23 16:06:48.202662 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 316/638] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:48 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:48.980678 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e44440ae-0560-43ee-9667-97b6bb4ac5ec tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:48.981300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e44440ae-0560-43ee-9667-97b6bb4ac5ec tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:48.988216 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e44440ae-0560-43ee-9667-97b6bb4ac5ec tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:48.988657 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e44440ae-0560-43ee-9667-97b6bb4ac5ec tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:48.989406 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e44440ae-0560-43ee-9667-97b6bb4ac5ec tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:48.989906 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e44440ae-0560-43ee-9667-97b6bb4ac5ec tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:49.126148 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e44440ae-0560-43ee-9667-97b6bb4ac5ec tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:49.134280 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e44440ae-0560-43ee-9667-97b6bb4ac5ec tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.157462 Jun 23 16:06:49.134887 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 323/639] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:48 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:49.221183 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5b729c6f-7a52-4887-b66b-d08b6602c713 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:49.221783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5b729c6f-7a52-4887-b66b-d08b6602c713 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:49.228316 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b729c6f-7a52-4887-b66b-d08b6602c713 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:49.228755 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b729c6f-7a52-4887-b66b-d08b6602c713 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:49.229498 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b729c6f-7a52-4887-b66b-d08b6602c713 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:49.229925 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b729c6f-7a52-4887-b66b-d08b6602c713 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:49.361564 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5b729c6f-7a52-4887-b66b-d08b6602c713 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:49.371046 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5b729c6f-7a52-4887-b66b-d08b6602c713 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.154191 Jun 23 16:06:49.371634 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 317/640] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:49 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:50.152132 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-61218e22-ba6b-4bcc-a6ac-684cc7d5fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:50.152752 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-61218e22-ba6b-4bcc-a6ac-684cc7d5fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:50.159735 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61218e22-ba6b-4bcc-a6ac-684cc7d5fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:50.160172 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61218e22-ba6b-4bcc-a6ac-684cc7d5fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:50.160920 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61218e22-ba6b-4bcc-a6ac-684cc7d5fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:50.161348 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-61218e22-ba6b-4bcc-a6ac-684cc7d5fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:50.287883 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-61218e22-ba6b-4bcc-a6ac-684cc7d5fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:50.295848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-61218e22-ba6b-4bcc-a6ac-684cc7d5fb6f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1734 microversion: 2.1 time: 0.147842 Jun 23 16:06:50.296426 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 324/641] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:50 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:50.387984 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-42aa2ea2-6bda-40cd-8fc0-6e68093708de tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:50.388586 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-42aa2ea2-6bda-40cd-8fc0-6e68093708de tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:50.396867 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-42aa2ea2-6bda-40cd-8fc0-6e68093708de tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:50.397327 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-42aa2ea2-6bda-40cd-8fc0-6e68093708de tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:50.398103 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-42aa2ea2-6bda-40cd-8fc0-6e68093708de tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:50.398820 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-42aa2ea2-6bda-40cd-8fc0-6e68093708de tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:50.528748 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-42aa2ea2-6bda-40cd-8fc0-6e68093708de tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:50.537501 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-42aa2ea2-6bda-40cd-8fc0-6e68093708de tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.153270 Jun 23 16:06:50.538066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 318/642] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:50 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:51.313572 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6f41438b-f315-4b29-9dcd-80edd4d219f4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:51.314206 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6f41438b-f315-4b29-9dcd-80edd4d219f4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:51.320816 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f41438b-f315-4b29-9dcd-80edd4d219f4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:51.321257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f41438b-f315-4b29-9dcd-80edd4d219f4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:51.322010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f41438b-f315-4b29-9dcd-80edd4d219f4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:51.322436 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6f41438b-f315-4b29-9dcd-80edd4d219f4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:51.455888 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6f41438b-f315-4b29-9dcd-80edd4d219f4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:51.457946 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:51.464722 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6f41438b-f315-4b29-9dcd-80edd4d219f4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1714 microversion: 2.1 time: 0.155696 Jun 23 16:06:51.465282 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 325/643] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:51 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:51.520417 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-96f16587-449b-423d-807c-7900142104fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:51.520933 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-96f16587-449b-423d-807c-7900142104fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:51.527730 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96f16587-449b-423d-807c-7900142104fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:51.528173 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96f16587-449b-423d-807c-7900142104fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:51.528941 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96f16587-449b-423d-807c-7900142104fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:51.529376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-96f16587-449b-423d-807c-7900142104fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:51.556680 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-be5a729f-e362-48a2-a62e-5382294adcb7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:51.557252 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-be5a729f-e362-48a2-a62e-5382294adcb7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:51.565264 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be5a729f-e362-48a2-a62e-5382294adcb7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:51.565635 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be5a729f-e362-48a2-a62e-5382294adcb7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:51.566391 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be5a729f-e362-48a2-a62e-5382294adcb7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:51.566923 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be5a729f-e362-48a2-a62e-5382294adcb7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:51.659440 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-96f16587-449b-423d-807c-7900142104fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] HTTP exception thrown: Cannot 'detach_volume' instance 649b033e-63c2-44c2-a597-4192007bb977 while it is in vm_state rescued Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-96f16587-449b-423d-807c-7900142104fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Request method failure captured: Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments/c9a37c63-f49b-4202-8532-27652b689bec HTTP/1.1 Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4982N4I_q1MLhQUv7y__IsTVoVc_C4A24OIRUWCLxOkcQRrieSI2Pgytioaui_Pr0ZQoJFeqaHf1eDAR_1T3_jnmf7FblklhXX0H_LWu40tqQfHG6AN_wxK_-rLlHUEZPc4McdEJGI7Ye5KaaAaL_t5OM8F7CV92nevHTHOuzjgeg Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: f9eeca1030964294b8d813812abdcc5b Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:06:51.661031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f9eeca1030964294b8d813812abdcc5b"}]}] Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: f9eeca1030964294b8d813812abdcc5b Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-ServerRescueNegativeTestJSON-494893856-project Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: 228e5acf4578494ab1a28e4f530233f2 Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-ServerRescueNegativeTestJSON-494893856-project Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:06:51.662600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Cannot 'detach_volume' instance 649b033e-63c2-44c2-a597-4192007bb977 while it is in vm_state rescued Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'server_id': '649b033e-63c2-44c2-a597-4192007bb977', 'id': 'c9a37c63-f49b-4202-8532-27652b689bec'} Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 649b033e-63c2-44c2-a597-4192007bb977 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:06:51.663419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 649b033e-63c2-44c2-a597-4192007bb977 while it is in vm_state rescued Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 649b033e-63c2-44c2-a597-4192007bb977 while it is in vm_state rescued Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:06:51.665175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-96f16587-449b-423d-807c-7900142104fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Returning 409 to user: Cannot 'detach_volume' instance 649b033e-63c2-44c2-a597-4192007bb977 while it is in vm_state rescued {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:06:51.666665 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-96f16587-449b-423d-807c-7900142104fe tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments/c9a37c63-f49b-4202-8532-27652b689bec" status: 409 len: 152 microversion: 2.1 time: 0.145987 Jun 23 16:06:51.666665 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 319/644] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 23 16:06:51 2022] DELETE /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments/c9a37c63-f49b-4202-8532-27652b689bec => generated 152 bytes in 147 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 16:06:51.671789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9ce03931-145d-40ac-a435-e179f34724dd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:06:51.672326 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9ce03931-145d-40ac-a435-e179f34724dd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:51.678908 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9ce03931-145d-40ac-a435-e179f34724dd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:51.679357 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9ce03931-145d-40ac-a435-e179f34724dd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:51.680121 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9ce03931-145d-40ac-a435-e179f34724dd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:51.680556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9ce03931-145d-40ac-a435-e179f34724dd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:51.699912 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-be5a729f-e362-48a2-a62e-5382294adcb7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:51.708666 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-be5a729f-e362-48a2-a62e-5382294adcb7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.156167 Jun 23 16:06:51.709350 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 326/645] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:51 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:06:51.746653 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9ce03931-145d-40ac-a435-e179f34724dd tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "POST /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/action" status: 202 len: 0 microversion: 2.1 time: 0.078940 Jun 23 16:06:51.747344 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 320/646] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:06:51 2022] POST /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 16:06:51.755471 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5df68a84-b343-480f-87c1-5bac37c10f00 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:51.756124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5df68a84-b343-480f-87c1-5bac37c10f00 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:51.762455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5df68a84-b343-480f-87c1-5bac37c10f00 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:51.763170 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5df68a84-b343-480f-87c1-5bac37c10f00 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:51.763964 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5df68a84-b343-480f-87c1-5bac37c10f00 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:51.764911 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5df68a84-b343-480f-87c1-5bac37c10f00 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:51.983815 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5df68a84-b343-480f-87c1-5bac37c10f00 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:51.991876 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5df68a84-b343-480f-87c1-5bac37c10f00 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1722 microversion: 2.1 time: 0.240233 Jun 23 16:06:51.992462 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 327/647] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:51 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:52.726371 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e4e09843-b3da-4f9b-aac5-691b4a759bcc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:52.727137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e4e09843-b3da-4f9b-aac5-691b4a759bcc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:52.733985 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e4e09843-b3da-4f9b-aac5-691b4a759bcc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:52.734449 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e4e09843-b3da-4f9b-aac5-691b4a759bcc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:52.735248 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e4e09843-b3da-4f9b-aac5-691b4a759bcc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:52.735698 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e4e09843-b3da-4f9b-aac5-691b4a759bcc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:52.880995 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e4e09843-b3da-4f9b-aac5-691b4a759bcc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:52.888975 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e4e09843-b3da-4f9b-aac5-691b4a759bcc tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.167356 Jun 23 16:06:52.889540 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 321/648] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:52 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:53.009111 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d995efa0-7a6e-4046-8412-17fed15da079 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:53.009718 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d995efa0-7a6e-4046-8412-17fed15da079 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:53.016213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d995efa0-7a6e-4046-8412-17fed15da079 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:53.016662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d995efa0-7a6e-4046-8412-17fed15da079 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:53.017424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d995efa0-7a6e-4046-8412-17fed15da079 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:53.017857 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d995efa0-7a6e-4046-8412-17fed15da079 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:53.154234 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d995efa0-7a6e-4046-8412-17fed15da079 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:53.162958 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d995efa0-7a6e-4046-8412-17fed15da079 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1722 microversion: 2.1 time: 0.157693 Jun 23 16:06:53.163519 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 328/649] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:53 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:53.906046 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5b048820-b0dd-4614-870f-0997fc506f56 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:53.906713 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5b048820-b0dd-4614-870f-0997fc506f56 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:53.913152 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b048820-b0dd-4614-870f-0997fc506f56 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:53.913595 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b048820-b0dd-4614-870f-0997fc506f56 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:53.914350 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b048820-b0dd-4614-870f-0997fc506f56 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:53.914821 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5b048820-b0dd-4614-870f-0997fc506f56 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:54.042440 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5b048820-b0dd-4614-870f-0997fc506f56 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:54.050868 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5b048820-b0dd-4614-870f-0997fc506f56 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.148662 Jun 23 16:06:54.051429 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 322/650] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:53 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:54.180917 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4cedc116-d99d-4678-9d27-110586b6dedf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:54.181579 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4cedc116-d99d-4678-9d27-110586b6dedf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:54.188836 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4cedc116-d99d-4678-9d27-110586b6dedf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:54.189275 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4cedc116-d99d-4678-9d27-110586b6dedf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:54.190024 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4cedc116-d99d-4678-9d27-110586b6dedf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:54.190504 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4cedc116-d99d-4678-9d27-110586b6dedf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:54.319779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4cedc116-d99d-4678-9d27-110586b6dedf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:54.327726 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4cedc116-d99d-4678-9d27-110586b6dedf tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1722 microversion: 2.1 time: 0.150768 Jun 23 16:06:54.328286 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 329/651] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:54 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:55.067138 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c74de7b6-fb47-4951-913a-82bc025ed439 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:55.067770 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c74de7b6-fb47-4951-913a-82bc025ed439 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:55.074247 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c74de7b6-fb47-4951-913a-82bc025ed439 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:55.074702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c74de7b6-fb47-4951-913a-82bc025ed439 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:55.075473 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c74de7b6-fb47-4951-913a-82bc025ed439 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:55.075908 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c74de7b6-fb47-4951-913a-82bc025ed439 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:55.217593 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c74de7b6-fb47-4951-913a-82bc025ed439 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:55.225536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c74de7b6-fb47-4951-913a-82bc025ed439 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1724 microversion: 2.1 time: 0.162196 Jun 23 16:06:55.226093 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 323/652] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:55 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:55.344935 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-44f43c87-8d45-46ee-9ae0-fbf64ee305e4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:55.345551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-44f43c87-8d45-46ee-9ae0-fbf64ee305e4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:55.352090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44f43c87-8d45-46ee-9ae0-fbf64ee305e4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:55.352538 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44f43c87-8d45-46ee-9ae0-fbf64ee305e4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:55.353301 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44f43c87-8d45-46ee-9ae0-fbf64ee305e4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:55.353739 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44f43c87-8d45-46ee-9ae0-fbf64ee305e4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:55.488812 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-44f43c87-8d45-46ee-9ae0-fbf64ee305e4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:55.496849 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-44f43c87-8d45-46ee-9ae0-fbf64ee305e4 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1722 microversion: 2.1 time: 0.155931 Jun 23 16:06:55.497413 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 330/653] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:55 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:56.242916 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a539ca6a-07e9-4434-8cb2-f585866134fb tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:56.243472 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a539ca6a-07e9-4434-8cb2-f585866134fb tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:56.249900 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a539ca6a-07e9-4434-8cb2-f585866134fb tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:56.250347 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a539ca6a-07e9-4434-8cb2-f585866134fb tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:56.251126 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a539ca6a-07e9-4434-8cb2-f585866134fb tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:56.251566 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a539ca6a-07e9-4434-8cb2-f585866134fb tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:56.380204 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a539ca6a-07e9-4434-8cb2-f585866134fb tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:56.388149 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a539ca6a-07e9-4434-8cb2-f585866134fb tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1701 microversion: 2.1 time: 0.149344 Jun 23 16:06:56.388731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 324/654] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:56 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1701 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:56.405672 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-58bdedcc-c7df-449f-9945-2883b830ea3c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:06:56.411948 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58bdedcc-c7df-449f-9945-2883b830ea3c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:56.412397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-58bdedcc-c7df-449f-9945-2883b830ea3c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:56.433753 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-58bdedcc-c7df-449f-9945-2883b830ea3c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Going to try to start instance {{(pid=117890) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 16:06:56.474923 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-58bdedcc-c7df-449f-9945-2883b830ea3c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/action" status: 202 len: 0 microversion: 2.1 time: 0.073585 Jun 23 16:06:56.475524 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 331/655] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:06:56 2022] POST /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:06:56.483572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a0219892-3cde-4851-843a-d08c02831e07 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:56.484180 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a0219892-3cde-4851-843a-d08c02831e07 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:56.490540 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0219892-3cde-4851-843a-d08c02831e07 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:56.491159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0219892-3cde-4851-843a-d08c02831e07 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:56.491921 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0219892-3cde-4851-843a-d08c02831e07 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:56.492357 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0219892-3cde-4851-843a-d08c02831e07 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:56.515970 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2da0f727-2e24-4467-9822-3f71a09e34e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:56.516663 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2da0f727-2e24-4467-9822-3f71a09e34e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:56.526338 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2da0f727-2e24-4467-9822-3f71a09e34e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:56.526946 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2da0f727-2e24-4467-9822-3f71a09e34e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:56.528403 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2da0f727-2e24-4467-9822-3f71a09e34e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:56.528884 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2da0f727-2e24-4467-9822-3f71a09e34e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:56.633558 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a0219892-3cde-4851-843a-d08c02831e07 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:56.642592 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a0219892-3cde-4851-843a-d08c02831e07 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1710 microversion: 2.1 time: 0.162769 Jun 23 16:06:56.643191 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 325/656] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:56 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1710 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:06:56.760415 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2da0f727-2e24-4467-9822-3f71a09e34e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:56.769277 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2da0f727-2e24-4467-9822-3f71a09e34e9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1728 microversion: 2.1 time: 0.257797 Jun 23 16:06:56.769866 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 332/657] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:56 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1728 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:06:56.786073 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-26a5bf5c-91c1-423f-8bc8-d45e792da257 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:56.786564 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-26a5bf5c-91c1-423f-8bc8-d45e792da257 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:56.792585 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26a5bf5c-91c1-423f-8bc8-d45e792da257 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:56.793034 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26a5bf5c-91c1-423f-8bc8-d45e792da257 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:56.793789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26a5bf5c-91c1-423f-8bc8-d45e792da257 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:56.794220 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-26a5bf5c-91c1-423f-8bc8-d45e792da257 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:56.876546 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-26a5bf5c-91c1-423f-8bc8-d45e792da257 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094272 Jun 23 16:06:56.877134 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 326/658] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 23 16:06:56 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:06:57.660607 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-185f9d5d-5ee3-4383-85b9-32e250c849a2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:57.661210 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-185f9d5d-5ee3-4383-85b9-32e250c849a2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:57.667766 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-185f9d5d-5ee3-4383-85b9-32e250c849a2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:57.668216 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-185f9d5d-5ee3-4383-85b9-32e250c849a2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:57.668993 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-185f9d5d-5ee3-4383-85b9-32e250c849a2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:57.669431 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-185f9d5d-5ee3-4383-85b9-32e250c849a2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:57.800295 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-185f9d5d-5ee3-4383-85b9-32e250c849a2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:57.808441 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-185f9d5d-5ee3-4383-85b9-32e250c849a2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1710 microversion: 2.1 time: 0.151649 Jun 23 16:06:57.809020 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 333/659] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:57 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:06:58.402074 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-c8978fe3-9180-4e88-b971-8043e0519fe3 req-22591e2b-7cda-48cb-91f0-af143f8d0655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "649b033e-63c2-44c2-a597-4192007bb977", "tag": "c631e37e-f39c-4dd5-871a-90b0efe598ae"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:06:58.406795 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=50 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:58.411534 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-c8978fe3-9180-4e88-b971-8043e0519fe3 req-22591e2b-7cda-48cb-91f0-af143f8d0655 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:58.411980 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-c8978fe3-9180-4e88-b971-8043e0519fe3 req-22591e2b-7cda-48cb-91f0-af143f8d0655 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:58.416778 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:06:58.424777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-c8978fe3-9180-4e88-b971-8043e0519fe3 req-22591e2b-7cda-48cb-91f0-af143f8d0655 service nova] Creating event network-changed:c631e37e-f39c-4dd5-871a-90b0efe598ae for instance 649b033e-63c2-44c2-a597-4192007bb977 on hv-cinder-83538 Jun 23 16:06:58.430212 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-c8978fe3-9180-4e88-b971-8043e0519fe3 req-22591e2b-7cda-48cb-91f0-af143f8d0655 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098831 Jun 23 16:06:58.430829 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 327/660] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:06:58.825518 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4734e2ad-3c5e-47af-a5a1-4e1ec41df9c6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:06:58.826114 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4734e2ad-3c5e-47af-a5a1-4e1ec41df9c6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:06:58.833583 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4734e2ad-3c5e-47af-a5a1-4e1ec41df9c6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:58.834026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4734e2ad-3c5e-47af-a5a1-4e1ec41df9c6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:58.834824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4734e2ad-3c5e-47af-a5a1-4e1ec41df9c6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:06:58.835255 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4734e2ad-3c5e-47af-a5a1-4e1ec41df9c6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:06:58.969532 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4734e2ad-3c5e-47af-a5a1-4e1ec41df9c6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:06:58.977623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4734e2ad-3c5e-47af-a5a1-4e1ec41df9c6 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1714 microversion: 2.1 time: 0.156086 Jun 23 16:06:58.978186 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 334/661] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:06:58 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:00.452477 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-e0975210-a83e-4532-8f18-bbf02c2d184a req-5d9c205e-44d8-4979-a0e5-10045a8af87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "649b033e-63c2-44c2-a597-4192007bb977", "tag": "c631e37e-f39c-4dd5-871a-90b0efe598ae"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:00.461858 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-e0975210-a83e-4532-8f18-bbf02c2d184a req-5d9c205e-44d8-4979-a0e5-10045a8af87b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:00.462294 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-e0975210-a83e-4532-8f18-bbf02c2d184a req-5d9c205e-44d8-4979-a0e5-10045a8af87b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:00.473030 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-e0975210-a83e-4532-8f18-bbf02c2d184a req-5d9c205e-44d8-4979-a0e5-10045a8af87b service nova] Creating event network-changed:c631e37e-f39c-4dd5-871a-90b0efe598ae for instance 649b033e-63c2-44c2-a597-4192007bb977 on hv-cinder-83538 Jun 23 16:07:00.477918 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-e0975210-a83e-4532-8f18-bbf02c2d184a req-5d9c205e-44d8-4979-a0e5-10045a8af87b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030967 Jun 23 16:07:00.478480 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 328/662] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:19.480794 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=31 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:19.481520 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:19.533424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7d2f22fb-2319-46da-950f-8a9f5e5805cc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:19.533919 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7d2f22fb-2319-46da-950f-8a9f5e5805cc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:19.540114 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d2f22fb-2319-46da-950f-8a9f5e5805cc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:19.540557 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d2f22fb-2319-46da-950f-8a9f5e5805cc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:19.541318 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d2f22fb-2319-46da-950f-8a9f5e5805cc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:19.541753 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d2f22fb-2319-46da-950f-8a9f5e5805cc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:19.566141 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7d2f22fb-2319-46da-950f-8a9f5e5805cc tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7/ips" status: 200 len: 149 microversion: 2.1 time: 0.090727 Jun 23 16:07:19.566719 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 335/663] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 23 16:07:19 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7/ips => generated 149 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:19.577718 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b7cdf082-ef26-456d-8784-922f9256a671 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34279923-4f36-446c-8b64-0ec926119801"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:19.578888 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b7cdf082-ef26-456d-8784-922f9256a671 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:19.581522 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:19.582191 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:19.588314 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7cdf082-ef26-456d-8784-922f9256a671 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:19.588762 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7cdf082-ef26-456d-8784-922f9256a671 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:19.589574 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7cdf082-ef26-456d-8784-922f9256a671 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:19.589963 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b7cdf082-ef26-456d-8784-922f9256a671 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:19.668745 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-b7cdf082-ef26-456d-8784-922f9256a671 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Invalid volume: volume 34279923-4f36-446c-8b64-0ec926119801 is already attached to instances: 0aa6e984-d2b4-48ea-b887-250c0935b0be Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b7cdf082-ef26-456d-8784-922f9256a671 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: POST /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7/os-volume_attachments HTTP/1.1 Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 74 Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:07:19.671130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {"volumeAttachment": {"volumeId": "34279923-4f36-446c-8b64-0ec926119801"}} Jun 23 16:07:19.672743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Invalid volume: volume 34279923-4f36-446c-8b64-0ec926119801 is already attached to instances: 0aa6e984-d2b4-48ea-b887-250c0935b0be Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'server_id': '47b18125-a7dc-4adf-8537-a1c18e79ccf7', 'body': {'volumeAttachment': {'volumeId': '34279923-4f36-446c-8b64-0ec926119801'}}} Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 34279923-4f36-446c-8b64-0ec926119801 is already attached to instances: 0aa6e984-d2b4-48ea-b887-250c0935b0be Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:07:19.673557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 34279923-4f36-446c-8b64-0ec926119801 is already attached to instances: 0aa6e984-d2b4-48ea-b887-250c0935b0be Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:19.674863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:07:19.676027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:07:19.676027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:07:19.676027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:07:19.676027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 34279923-4f36-446c-8b64-0ec926119801 is already attached to instances: 0aa6e984-d2b4-48ea-b887-250c0935b0be Jun 23 16:07:19.676027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:07:19.676027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b7cdf082-ef26-456d-8784-922f9256a671 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 400 to user: Invalid volume: volume 34279923-4f36-446c-8b64-0ec926119801 is already attached to instances: 0aa6e984-d2b4-48ea-b887-250c0935b0be {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:07:19.676027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b7cdf082-ef26-456d-8784-922f9256a671 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099262 Jun 23 16:07:19.676027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 329/664] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:07:19 2022] POST /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 16:07:19.681633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-016fc12e-cc45-40da-b3cd-42a917d78c74 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:19.682122 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-016fc12e-cc45-40da-b3cd-42a917d78c74 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:19.688912 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-016fc12e-cc45-40da-b3cd-42a917d78c74 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:19.689352 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-016fc12e-cc45-40da-b3cd-42a917d78c74 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:19.690101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-016fc12e-cc45-40da-b3cd-42a917d78c74 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:19.690526 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-016fc12e-cc45-40da-b3cd-42a917d78c74 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:19.715883 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-016fc12e-cc45-40da-b3cd-42a917d78c74 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:07:19.797860 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-016fc12e-cc45-40da-b3cd-42a917d78c74 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 204 len: 0 microversion: 2.1 time: 0.119620 Jun 23 16:07:19.798524 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 336/665] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:07:19 2022] DELETE /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:07:19.807250 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-428d5eb3-9235-462f-960c-24bc3cedcf6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:19.807979 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-428d5eb3-9235-462f-960c-24bc3cedcf6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:19.815198 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-428d5eb3-9235-462f-960c-24bc3cedcf6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:19.815645 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-428d5eb3-9235-462f-960c-24bc3cedcf6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:19.816406 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-428d5eb3-9235-462f-960c-24bc3cedcf6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:19.816839 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-428d5eb3-9235-462f-960c-24bc3cedcf6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:19.945855 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-428d5eb3-9235-462f-960c-24bc3cedcf6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:19.954039 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-428d5eb3-9235-462f-960c-24bc3cedcf6d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1682 microversion: 2.1 time: 0.150582 Jun 23 16:07:19.954597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 330/666] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:19 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:20.972648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-75eec8ce-a41b-432f-b53c-262f60cc8b53 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:20.973362 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-75eec8ce-a41b-432f-b53c-262f60cc8b53 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:20.979768 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-75eec8ce-a41b-432f-b53c-262f60cc8b53 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:20.980219 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-75eec8ce-a41b-432f-b53c-262f60cc8b53 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:20.980990 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-75eec8ce-a41b-432f-b53c-262f60cc8b53 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:20.981451 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-75eec8ce-a41b-432f-b53c-262f60cc8b53 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:21.350168 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-75eec8ce-a41b-432f-b53c-262f60cc8b53 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:21.357578 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-75eec8ce-a41b-432f-b53c-262f60cc8b53 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1682 microversion: 2.1 time: 0.389210 Jun 23 16:07:21.358139 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 337/667] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:20 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1682 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:22.375711 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-842c9321-fb12-414e-9e39-f6bc068f6545 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:22.376315 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-842c9321-fb12-414e-9e39-f6bc068f6545 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:22.382653 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-842c9321-fb12-414e-9e39-f6bc068f6545 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:22.383124 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-842c9321-fb12-414e-9e39-f6bc068f6545 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:22.383968 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-842c9321-fb12-414e-9e39-f6bc068f6545 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:22.384319 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-842c9321-fb12-414e-9e39-f6bc068f6545 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:22.450331 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-842c9321-fb12-414e-9e39-f6bc068f6545 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:22.458233 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-842c9321-fb12-414e-9e39-f6bc068f6545 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 200 len: 1614 microversion: 2.1 time: 0.086742 Jun 23 16:07:22.458797 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 331/668] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:22 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 1614 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:22.699040 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-50af3987-64b0-4bd6-8ee0-851060746dd1 req-90ab9847-0aad-4285-a0c8-f8c197ede622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b18125-a7dc-4adf-8537-a1c18e79ccf7", "name": "network-vif-deleted", "tag": "381f3466-20ef-4ea9-928c-46f57ce0f0d8"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:22.710573 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-50af3987-64b0-4bd6-8ee0-851060746dd1 req-90ab9847-0aad-4285-a0c8-f8c197ede622 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:22.711628 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-50af3987-64b0-4bd6-8ee0-851060746dd1 req-90ab9847-0aad-4285-a0c8-f8c197ede622 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:22.725164 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-50af3987-64b0-4bd6-8ee0-851060746dd1 req-90ab9847-0aad-4285-a0c8-f8c197ede622 service nova] Creating event network-vif-deleted:381f3466-20ef-4ea9-928c-46f57ce0f0d8 for instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 on hv-cinder-83538 Jun 23 16:07:22.731706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-50af3987-64b0-4bd6-8ee0-851060746dd1 req-90ab9847-0aad-4285-a0c8-f8c197ede622 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115276 Jun 23 16:07:22.733602 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 338/669] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:23.475956 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d0276958-77b7-4349-9aa5-6d7807555cf4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:23.476576 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d0276958-77b7-4349-9aa5-6d7807555cf4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:23.483760 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0276958-77b7-4349-9aa5-6d7807555cf4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:23.484209 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0276958-77b7-4349-9aa5-6d7807555cf4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:23.484978 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0276958-77b7-4349-9aa5-6d7807555cf4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:23.485409 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0276958-77b7-4349-9aa5-6d7807555cf4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:23.500586 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-d0276958-77b7-4349-9aa5-6d7807555cf4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d0276958-77b7-4349-9aa5-6d7807555cf4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 HTTP/1.1 Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:07:23.502176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:07:23.503600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '47b18125-a7dc-4adf-8537-a1c18e79ccf7'} Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:07:23.504376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:07:23.506082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:07:23.508234 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d0276958-77b7-4349-9aa5-6d7807555cf4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:07:23.508234 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d0276958-77b7-4349-9aa5-6d7807555cf4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 404 len: 111 microversion: 2.1 time: 0.031539 Jun 23 16:07:23.508234 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 332/670] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:23 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:07:23.513222 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c7f77538-171a-4c69-aa54-e27c4cbbb27e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '.version_select at 0x7fe28d44e430>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:23.534856 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c7f77538-171a-4c69-aa54-e27c4cbbb27e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128415517" status: 202 len: 0 microversion: 2.1 time: 0.025168 Jun 23 16:07:23.539531 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 339/671] 10.222.0.46 () {58 vars in 1220 bytes} [Thu Jun 23 16:07:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2128415517 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:07:24.238007 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-156cd703-47f5-4ace-8484-4553272a5deb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:24.238505 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-156cd703-47f5-4ace-8484-4553272a5deb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:24.244703 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-156cd703-47f5-4ace-8484-4553272a5deb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:24.245145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-156cd703-47f5-4ace-8484-4553272a5deb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:24.245899 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-156cd703-47f5-4ace-8484-4553272a5deb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:24.246329 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-156cd703-47f5-4ace-8484-4553272a5deb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:24.329194 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-156cd703-47f5-4ace-8484-4553272a5deb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lazy-loading 'services' on Instance uuid 0aa6e984-d2b4-48ea-b887-250c0935b0be {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:07:24.441518 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-156cd703-47f5-4ace-8484-4553272a5deb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-volume_attachments/34279923-4f36-446c-8b64-0ec926119801" status: 202 len: 0 microversion: 2.1 time: 0.207177 Jun 23 16:07:24.442362 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 333/672] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 23 16:07:24 2022] DELETE /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-volume_attachments/34279923-4f36-446c-8b64-0ec926119801 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:07:24.452008 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d56ce582-f30a-41f5-bbbe-f20f05a903e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:24.453049 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d56ce582-f30a-41f5-bbbe-f20f05a903e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:24.462782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d56ce582-f30a-41f5-bbbe-f20f05a903e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:24.463177 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d56ce582-f30a-41f5-bbbe-f20f05a903e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:24.464044 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d56ce582-f30a-41f5-bbbe-f20f05a903e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:24.464487 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d56ce582-f30a-41f5-bbbe-f20f05a903e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:24.493924 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d56ce582-f30a-41f5-bbbe-f20f05a903e8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047048 Jun 23 16:07:24.494492 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 340/673] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:07:24 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:25.506893 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9cba9ed6-cf76-446a-832c-d5e83d1256e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:25.507893 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9cba9ed6-cf76-446a-832c-d5e83d1256e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:25.514477 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9cba9ed6-cf76-446a-832c-d5e83d1256e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:25.514959 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9cba9ed6-cf76-446a-832c-d5e83d1256e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:25.515733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9cba9ed6-cf76-446a-832c-d5e83d1256e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:25.516171 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9cba9ed6-cf76-446a-832c-d5e83d1256e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:25.547480 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9cba9ed6-cf76-446a-832c-d5e83d1256e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045384 Jun 23 16:07:25.548339 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 334/674] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:07:25 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:26.559428 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f514e48c-4dd5-4fed-ab18-e9de580dcc1b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:26.560368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f514e48c-4dd5-4fed-ab18-e9de580dcc1b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:26.567037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f514e48c-4dd5-4fed-ab18-e9de580dcc1b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:26.567479 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f514e48c-4dd5-4fed-ab18-e9de580dcc1b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:26.568224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f514e48c-4dd5-4fed-ab18-e9de580dcc1b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:26.568651 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f514e48c-4dd5-4fed-ab18-e9de580dcc1b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:26.597262 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f514e48c-4dd5-4fed-ab18-e9de580dcc1b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041730 Jun 23 16:07:26.597804 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 341/675] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:07:26 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 16:07:26.654430 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-670d4c4d-fda5-4ca5-a74c-a89731c274d2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:26.654951 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-670d4c4d-fda5-4ca5-a74c-a89731c274d2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:26.661298 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-670d4c4d-fda5-4ca5-a74c-a89731c274d2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:26.661744 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-670d4c4d-fda5-4ca5-a74c-a89731c274d2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:26.662504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-670d4c4d-fda5-4ca5-a74c-a89731c274d2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:26.662976 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-670d4c4d-fda5-4ca5-a74c-a89731c274d2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:26.687531 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-670d4c4d-fda5-4ca5-a74c-a89731c274d2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:07:26.761259 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-670d4c4d-fda5-4ca5-a74c-a89731c274d2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 204 len: 0 microversion: 2.1 time: 0.110102 Jun 23 16:07:26.762043 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 335/676] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:07:26 2022] DELETE /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 16:07:26.770808 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-af417873-a3b6-4936-bd79-d6b4164199de tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:26.771422 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-af417873-a3b6-4936-bd79-d6b4164199de tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:26.777785 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-af417873-a3b6-4936-bd79-d6b4164199de tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:26.778236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-af417873-a3b6-4936-bd79-d6b4164199de tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:26.779105 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-af417873-a3b6-4936-bd79-d6b4164199de tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:26.779498 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-af417873-a3b6-4936-bd79-d6b4164199de tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:26.911459 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-af417873-a3b6-4936-bd79-d6b4164199de tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:26.918961 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-af417873-a3b6-4936-bd79-d6b4164199de tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1682 microversion: 2.1 time: 0.152003 Jun 23 16:07:26.919522 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 342/677] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:26 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:27.935592 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-722b0ba7-d5f7-4ec1-9829-9301589bd220 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:27.936301 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-722b0ba7-d5f7-4ec1-9829-9301589bd220 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:27.942671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-722b0ba7-d5f7-4ec1-9829-9301589bd220 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:27.943135 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-722b0ba7-d5f7-4ec1-9829-9301589bd220 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:27.943884 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-722b0ba7-d5f7-4ec1-9829-9301589bd220 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:27.944303 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-722b0ba7-d5f7-4ec1-9829-9301589bd220 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:28.078471 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-722b0ba7-d5f7-4ec1-9829-9301589bd220 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:28.086143 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-722b0ba7-d5f7-4ec1-9829-9301589bd220 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1682 microversion: 2.1 time: 0.154601 Jun 23 16:07:28.086634 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 336/678] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:27 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:28.574428 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-d7db57cb-e8be-49e7-b4f3-c5e4a59d0a0b req-88423f4d-58dc-4107-842c-34c39f73e7ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa6e984-d2b4-48ea-b887-250c0935b0be", "name": "network-vif-deleted", "tag": "ab7781e0-6518-45fd-8136-cb944ebb585a"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:28.586195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-d7db57cb-e8be-49e7-b4f3-c5e4a59d0a0b req-88423f4d-58dc-4107-842c-34c39f73e7ab service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:28.586828 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-d7db57cb-e8be-49e7-b4f3-c5e4a59d0a0b req-88423f4d-58dc-4107-842c-34c39f73e7ab service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:28.600916 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-d7db57cb-e8be-49e7-b4f3-c5e4a59d0a0b req-88423f4d-58dc-4107-842c-34c39f73e7ab service nova] Creating event network-vif-deleted:ab7781e0-6518-45fd-8136-cb944ebb585a for instance 0aa6e984-d2b4-48ea-b887-250c0935b0be on hv-cinder-83538 Jun 23 16:07:28.608584 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-d7db57cb-e8be-49e7-b4f3-c5e4a59d0a0b req-88423f4d-58dc-4107-842c-34c39f73e7ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036929 Jun 23 16:07:28.609581 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 343/679] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:07:29.103603 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:29.104239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:29.111959 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:29.112672 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:29.113612 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:29.114242 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:29.150619 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:29.151131 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:29.151947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lazy-loading 'fault' on Instance uuid 0aa6e984-d2b4-48ea-b887-250c0935b0be {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:07:29.198581 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:29.206122 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9ba49d41-d097-459b-b50c-428406128a57 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 200 len: 1332 microversion: 2.1 time: 0.106534 Jun 23 16:07:29.206815 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 337/680] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:29 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:30.222877 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a5bcebed-234c-4a4b-b348-06e249350307 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:30.223582 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a5bcebed-234c-4a4b-b348-06e249350307 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:30.230460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a5bcebed-234c-4a4b-b348-06e249350307 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:30.230950 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a5bcebed-234c-4a4b-b348-06e249350307 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:30.231715 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a5bcebed-234c-4a4b-b348-06e249350307 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:30.232152 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a5bcebed-234c-4a4b-b348-06e249350307 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:30.245706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-a5bcebed-234c-4a4b-b348-06e249350307 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a5bcebed-234c-4a4b-b348-06e249350307 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be HTTP/1.1 Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:07:30.247361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:07:30.249474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '0aa6e984-d2b4-48ea-b887-250c0935b0be'} Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:07:30.250351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:07:30.251783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:07:30.253032 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a5bcebed-234c-4a4b-b348-06e249350307 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:07:30.253032 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a5bcebed-234c-4a4b-b348-06e249350307 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 404 len: 111 microversion: 2.1 time: 0.030129 Jun 23 16:07:30.253032 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 344/681] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:30 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:07:30.257985 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d73ed69d-6b45-4138-ba4e-d532ebc5799f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '.version_select at 0x7fe28d4b5b80>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:30.280424 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d73ed69d-6b45-4138-ba4e-d532ebc5799f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242117316" status: 202 len: 0 microversion: 2.1 time: 0.026063 Jun 23 16:07:30.280993 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 338/682] 10.222.0.46 () {58 vars in 1220 bytes} [Thu Jun 23 16:07:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242117316 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:07:30.902123 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e7ba9332-e250-46a8-9643-0c6380b41b20 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: .version_select at 0x7fe28d3bcf70>, body: {"keypair": {"name": "tempest-keypair-841223630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQXJndBVnuxE+BG5cHbuhVUX669C86vYbMz2CkrFn3Jm1X9ie4uLph5UaWdEHlAS/lrfFLNgOQrb5bRRuGqhhqPQDkmL0xQ+hrwTNdALv+q12lK4Sp+Fads6/CKJNgu1A=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:30.916848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-e7ba9332-e250-46a8-9643-0c6380b41b20 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for project 2063fb24abb5408794361a9032e56d3f. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:07:30.920668 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-e7ba9332-e250-46a8-9643-0c6380b41b20 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for user dac5e323b42f41859c85709a2b49623b and project 2063fb24abb5408794361a9032e56d3f. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:07:30.942798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e7ba9332-e250-46a8-9643-0c6380b41b20 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046241 Jun 23 16:07:30.943430 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 345/683] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 23 16:07:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:32.193719 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1261614041", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58e7bb1c-ec3e-4fa3-be98-70515568e1d4"}], "security_groups": [{"name": "tempest-securitygroup--79537330"}], "key_name": "tempest-keypair-841223630", "user_data": "}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:32.291981 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] validate_networks() for [('58e7bb1c-ec3e-4fa3-be98-70515568e1d4', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:07:32.699747 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:07:32.700195 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:07:32.700663 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:07:32.701069 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:07:32.701508 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:07:32.710965 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:32.711433 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:32.712235 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:32.712671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:32.729776 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for project 2063fb24abb5408794361a9032e56d3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:07:32.734155 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for user dac5e323b42f41859c85709a2b49623b and project 2063fb24abb5408794361a9032e56d3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:07:32.745003 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:07:32.747276 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:07:32.794386 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4a132c9f-48a9-4559-81d8-e9dea15a0593 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.605558 Jun 23 16:07:32.796075 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 339/684] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:07:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:07:32.806756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-381483fb-38f0-411e-b94f-3d7fdc7879c7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:32.807451 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-381483fb-38f0-411e-b94f-3d7fdc7879c7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:32.866574 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-381483fb-38f0-411e-b94f-3d7fdc7879c7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:32.873407 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-381483fb-38f0-411e-b94f-3d7fdc7879c7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1241 microversion: 2.1 time: 0.071172 Jun 23 16:07:32.874427 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 346/685] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:32 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:07:33.891637 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d8c99d91-1dd3-42c1-9445-2336ac32fcea tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:33.892351 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d8c99d91-1dd3-42c1-9445-2336ac32fcea tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:33.902223 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d8c99d91-1dd3-42c1-9445-2336ac32fcea tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:33.902962 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d8c99d91-1dd3-42c1-9445-2336ac32fcea tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:33.903742 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d8c99d91-1dd3-42c1-9445-2336ac32fcea tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:33.904355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d8c99d91-1dd3-42c1-9445-2336ac32fcea tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:33.972421 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d8c99d91-1dd3-42c1-9445-2336ac32fcea tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:33.980493 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d8c99d91-1dd3-42c1-9445-2336ac32fcea tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1311 microversion: 2.1 time: 0.093066 Jun 23 16:07:33.981070 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 340/686] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:33 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:34.998209 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-125f5ac5-4e77-486d-8a47-5c6ed50f230e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:34.998880 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-125f5ac5-4e77-486d-8a47-5c6ed50f230e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:35.006114 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-125f5ac5-4e77-486d-8a47-5c6ed50f230e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:35.006566 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-125f5ac5-4e77-486d-8a47-5c6ed50f230e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:35.007371 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-125f5ac5-4e77-486d-8a47-5c6ed50f230e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:35.007815 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-125f5ac5-4e77-486d-8a47-5c6ed50f230e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:35.231399 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-125f5ac5-4e77-486d-8a47-5c6ed50f230e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:35.238660 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-125f5ac5-4e77-486d-8a47-5c6ed50f230e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1365 microversion: 2.1 time: 0.244468 Jun 23 16:07:35.239246 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 347/687] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:34 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:35.582662 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-b3abf19b-1766-454b-b8c1-df01103ebd55 req-317cfebb-199a-44b1-888f-a1514c6feb56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c3b97d-6f9a-4ce8-8081-dd5903a13761", "tag": "db91a74b-77fc-40fb-bf12-5e5899ebd3e2"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:35.595516 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b3abf19b-1766-454b-b8c1-df01103ebd55 req-317cfebb-199a-44b1-888f-a1514c6feb56 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:35.596332 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b3abf19b-1766-454b-b8c1-df01103ebd55 req-317cfebb-199a-44b1-888f-a1514c6feb56 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:35.612421 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-b3abf19b-1766-454b-b8c1-df01103ebd55 req-317cfebb-199a-44b1-888f-a1514c6feb56 service nova] Creating event network-changed:db91a74b-77fc-40fb-bf12-5e5899ebd3e2 for instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 on hv-cinder-83538 Jun 23 16:07:35.617555 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-b3abf19b-1766-454b-b8c1-df01103ebd55 req-317cfebb-199a-44b1-888f-a1514c6feb56 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039150 Jun 23 16:07:35.618799 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 341/688] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:36.255833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-440bef68-c0de-4bcc-ac2c-906f98c99113 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:36.256450 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-440bef68-c0de-4bcc-ac2c-906f98c99113 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:36.262994 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-440bef68-c0de-4bcc-ac2c-906f98c99113 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:36.263443 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-440bef68-c0de-4bcc-ac2c-906f98c99113 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:36.264816 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-440bef68-c0de-4bcc-ac2c-906f98c99113 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:36.265250 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-440bef68-c0de-4bcc-ac2c-906f98c99113 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:36.394818 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-440bef68-c0de-4bcc-ac2c-906f98c99113 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:36.402782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-440bef68-c0de-4bcc-ac2c-906f98c99113 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1365 microversion: 2.1 time: 0.150810 Jun 23 16:07:36.403354 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 348/689] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:36 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:37.420713 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-453cbc5b-4476-481a-956b-80a9aad00f6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:37.421377 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-453cbc5b-4476-481a-956b-80a9aad00f6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:37.428287 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-453cbc5b-4476-481a-956b-80a9aad00f6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:37.428731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-453cbc5b-4476-481a-956b-80a9aad00f6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:37.429604 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-453cbc5b-4476-481a-956b-80a9aad00f6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:37.430047 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-453cbc5b-4476-481a-956b-80a9aad00f6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:37.560086 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-453cbc5b-4476-481a-956b-80a9aad00f6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:37.567623 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-453cbc5b-4476-481a-956b-80a9aad00f6a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1365 microversion: 2.1 time: 0.151750 Jun 23 16:07:37.568181 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 342/690] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:37 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:38.117714 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c843e241-addd-46bf-8da6-1c4354ca30f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:38.118303 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c843e241-addd-46bf-8da6-1c4354ca30f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:38.124803 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c843e241-addd-46bf-8da6-1c4354ca30f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:38.125248 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c843e241-addd-46bf-8da6-1c4354ca30f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:38.126007 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c843e241-addd-46bf-8da6-1c4354ca30f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:38.126441 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c843e241-addd-46bf-8da6-1c4354ca30f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:38.160628 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c843e241-addd-46bf-8da6-1c4354ca30f4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments/8024fb95-2cc0-417d-9212-7aab743dc013" status: 200 len: 194 microversion: 2.20 time: 0.046653 Jun 23 16:07:38.161231 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 349/691] 10.222.0.46 () {60 vars in 1453 bytes} [Thu Jun 23 16:07:38 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments/8024fb95-2cc0-417d-9212-7aab743dc013 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 16:07:38.238050 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-94cf5a99-c720-4ec2-afdb-338eca48b6c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:38.238536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-94cf5a99-c720-4ec2-afdb-338eca48b6c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:38.244829 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94cf5a99-c720-4ec2-afdb-338eca48b6c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:38.245324 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94cf5a99-c720-4ec2-afdb-338eca48b6c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:38.246075 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94cf5a99-c720-4ec2-afdb-338eca48b6c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:38.246506 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-94cf5a99-c720-4ec2-afdb-338eca48b6c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:38.331355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-94cf5a99-c720-4ec2-afdb-338eca48b6c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lazy-loading 'services' on Instance uuid 14021a2e-8af8-4292-996e-ea87ff7752e0 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:07:38.414606 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-94cf5a99-c720-4ec2-afdb-338eca48b6c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "DELETE /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments/8024fb95-2cc0-417d-9212-7aab743dc013" status: 202 len: 0 microversion: 2.20 time: 0.180509 Jun 23 16:07:38.415270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 343/692] 10.222.0.46 () {60 vars in 1456 bytes} [Thu Jun 23 16:07:38 2022] DELETE /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments/8024fb95-2cc0-417d-9212-7aab743dc013 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:07:38.423880 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-43f45fcf-d4a8-4c0b-91c9-21c62010f8eb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:38.424957 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-43f45fcf-d4a8-4c0b-91c9-21c62010f8eb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:38.431040 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43f45fcf-d4a8-4c0b-91c9-21c62010f8eb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:38.431479 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43f45fcf-d4a8-4c0b-91c9-21c62010f8eb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:38.432230 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43f45fcf-d4a8-4c0b-91c9-21c62010f8eb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:38.432658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43f45fcf-d4a8-4c0b-91c9-21c62010f8eb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:38.463889 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-43f45fcf-d4a8-4c0b-91c9-21c62010f8eb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044003 Jun 23 16:07:38.464449 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 350/693] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Jun 23 16:07:38 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 16:07:38.585627 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cde73073-8851-4c1f-b3e7-11aa725600e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:38.586324 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cde73073-8851-4c1f-b3e7-11aa725600e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:38.592573 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cde73073-8851-4c1f-b3e7-11aa725600e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:38.593016 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cde73073-8851-4c1f-b3e7-11aa725600e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:38.593769 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cde73073-8851-4c1f-b3e7-11aa725600e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:38.594201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cde73073-8851-4c1f-b3e7-11aa725600e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:38.722869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cde73073-8851-4c1f-b3e7-11aa725600e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:38.730210 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cde73073-8851-4c1f-b3e7-11aa725600e9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1365 microversion: 2.1 time: 0.149239 Jun 23 16:07:38.730794 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 344/694] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:38 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:39.367575 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e72749fa-981f-4ada-bf04-f31bb0b57542 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:39.368199 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e72749fa-981f-4ada-bf04-f31bb0b57542 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:39.375936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e72749fa-981f-4ada-bf04-f31bb0b57542 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:39.376690 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e72749fa-981f-4ada-bf04-f31bb0b57542 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:39.377472 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e72749fa-981f-4ada-bf04-f31bb0b57542 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:39.378220 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e72749fa-981f-4ada-bf04-f31bb0b57542 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:39.403489 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-e72749fa-981f-4ada-bf04-f31bb0b57542 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lazy-loading 'flavor' on Instance uuid e3d20925-62c2-42d3-9cd4-87cafcfcb78c {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:07:39.477541 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6c06a244-0140-4eb6-9d72-cce3442b59f2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:39.478719 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6c06a244-0140-4eb6-9d72-cce3442b59f2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:39.491974 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c06a244-0140-4eb6-9d72-cce3442b59f2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:39.492791 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c06a244-0140-4eb6-9d72-cce3442b59f2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:39.493810 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c06a244-0140-4eb6-9d72-cce3442b59f2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:39.494475 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c06a244-0140-4eb6-9d72-cce3442b59f2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:39.499677 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:39.507230 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e72749fa-981f-4ada-bf04-f31bb0b57542 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "POST /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c/action" status: 202 len: 0 microversion: 2.1 time: 0.143106 Jun 23 16:07:39.512283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 351/695] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:07:39 2022] POST /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:07:39.520954 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f6876a00-4210-4605-a345-dcec170fae21 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:39.521942 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f6876a00-4210-4605-a345-dcec170fae21 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:39.530966 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6876a00-4210-4605-a345-dcec170fae21 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:39.532002 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6876a00-4210-4605-a345-dcec170fae21 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:39.533413 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6876a00-4210-4605-a345-dcec170fae21 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:39.534050 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6876a00-4210-4605-a345-dcec170fae21 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:39.541451 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6c06a244-0140-4eb6-9d72-cce3442b59f2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.068352 Jun 23 16:07:39.546040 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 345/696] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Jun 23 16:07:39 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 16:07:39.693357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f6876a00-4210-4605-a345-dcec170fae21 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:39.703491 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f6876a00-4210-4605-a345-dcec170fae21 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.189518 Jun 23 16:07:39.714119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 352/697] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:39 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:39.746887 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3b20f74a-7d78-44cc-9af6-f8eaf0080d4b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:39.747866 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3b20f74a-7d78-44cc-9af6-f8eaf0080d4b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:39.755414 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b20f74a-7d78-44cc-9af6-f8eaf0080d4b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:39.755881 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b20f74a-7d78-44cc-9af6-f8eaf0080d4b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:39.756827 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b20f74a-7d78-44cc-9af6-f8eaf0080d4b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:39.757490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b20f74a-7d78-44cc-9af6-f8eaf0080d4b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:39.898639 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3b20f74a-7d78-44cc-9af6-f8eaf0080d4b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:39.906025 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3b20f74a-7d78-44cc-9af6-f8eaf0080d4b tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1365 microversion: 2.1 time: 0.163511 Jun 23 16:07:39.906581 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 346/698] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:39 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:40.553370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-729c481c-77f6-43ea-a584-365104965ceb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:40.554428 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-729c481c-77f6-43ea-a584-365104965ceb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:40.561198 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-729c481c-77f6-43ea-a584-365104965ceb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:40.561651 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-729c481c-77f6-43ea-a584-365104965ceb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:40.562431 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-729c481c-77f6-43ea-a584-365104965ceb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:40.562907 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-729c481c-77f6-43ea-a584-365104965ceb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:40.566709 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:40.594413 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-729c481c-77f6-43ea-a584-365104965ceb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045086 Jun 23 16:07:40.595007 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 353/699] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Jun 23 16:07:40 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:40.655080 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b20aed72-df37-42db-9494-cac70383fbf3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:40.655572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b20aed72-df37-42db-9494-cac70383fbf3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:40.661607 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b20aed72-df37-42db-9494-cac70383fbf3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:40.662051 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b20aed72-df37-42db-9494-cac70383fbf3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:40.662821 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b20aed72-df37-42db-9494-cac70383fbf3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:40.663246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b20aed72-df37-42db-9494-cac70383fbf3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:40.687409 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b20aed72-df37-42db-9494-cac70383fbf3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:07:40.721957 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0b5d75ea-5adc-4baf-b520-7866dec4dee8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:40.722679 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0b5d75ea-5adc-4baf-b520-7866dec4dee8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:40.729179 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b5d75ea-5adc-4baf-b520-7866dec4dee8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:40.729632 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b5d75ea-5adc-4baf-b520-7866dec4dee8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:40.730406 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b5d75ea-5adc-4baf-b520-7866dec4dee8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:40.730884 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0b5d75ea-5adc-4baf-b520-7866dec4dee8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:40.763391 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b20aed72-df37-42db-9494-cac70383fbf3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "DELETE /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 204 len: 0 microversion: 2.20 time: 0.112357 Jun 23 16:07:40.764924 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 347/700] 10.222.0.46 () {60 vars in 1279 bytes} [Thu Jun 23 16:07:40 2022] DELETE /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 16:07:40.774439 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0c21bd36-77f5-4912-96f0-b820be5479df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:40.775163 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0c21bd36-77f5-4912-96f0-b820be5479df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:40.782089 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0c21bd36-77f5-4912-96f0-b820be5479df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:40.782527 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0c21bd36-77f5-4912-96f0-b820be5479df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:40.783333 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0c21bd36-77f5-4912-96f0-b820be5479df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:40.783758 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0c21bd36-77f5-4912-96f0-b820be5479df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:40.879604 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0b5d75ea-5adc-4baf-b520-7866dec4dee8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:40.887040 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0b5d75ea-5adc-4baf-b520-7866dec4dee8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.168885 Jun 23 16:07:40.887619 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 354/701] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:40 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:40.918502 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0c21bd36-77f5-4912-96f0-b820be5479df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:40.922833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b3512f39-4b53-4397-8ec8-6da1699b1d44 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:40.923448 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b3512f39-4b53-4397-8ec8-6da1699b1d44 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:40.926779 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0c21bd36-77f5-4912-96f0-b820be5479df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:40.928282 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0c21bd36-77f5-4912-96f0-b820be5479df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:40.929443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0c21bd36-77f5-4912-96f0-b820be5479df tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.160207 Jun 23 16:07:40.929555 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3512f39-4b53-4397-8ec8-6da1699b1d44 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:40.929898 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3512f39-4b53-4397-8ec8-6da1699b1d44 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:40.930104 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 348/702] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:40 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:07:40.930666 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3512f39-4b53-4397-8ec8-6da1699b1d44 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:40.931127 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3512f39-4b53-4397-8ec8-6da1699b1d44 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:41.058899 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b3512f39-4b53-4397-8ec8-6da1699b1d44 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:41.066782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b3512f39-4b53-4397-8ec8-6da1699b1d44 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1365 microversion: 2.1 time: 0.147808 Jun 23 16:07:41.067342 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 355/703] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:40 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:07:41.493149 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-7ec487af-85e9-4f4f-8f89-015569ef64a2 req-0408bdba-f8c9-4452-8f22-f7636b5cec13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c3b97d-6f9a-4ce8-8081-dd5903a13761", "name": "network-vif-plugged", "status": "completed", "tag": "db91a74b-77fc-40fb-bf12-5e5899ebd3e2"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:41.503254 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-7ec487af-85e9-4f4f-8f89-015569ef64a2 req-0408bdba-f8c9-4452-8f22-f7636b5cec13 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:41.503720 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-7ec487af-85e9-4f4f-8f89-015569ef64a2 req-0408bdba-f8c9-4452-8f22-f7636b5cec13 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:41.514438 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-7ec487af-85e9-4f4f-8f89-015569ef64a2 req-0408bdba-f8c9-4452-8f22-f7636b5cec13 service nova] Creating event network-vif-plugged:db91a74b-77fc-40fb-bf12-5e5899ebd3e2 for instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 on hv-cinder-83538 Jun 23 16:07:41.519235 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-7ec487af-85e9-4f4f-8f89-015569ef64a2 req-0408bdba-f8c9-4452-8f22-f7636b5cec13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086577 Jun 23 16:07:41.519762 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 349/704] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:41.905118 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f6ad0276-35be-47c7-b20d-e2f2aefdd68b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:41.905723 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f6ad0276-35be-47c7-b20d-e2f2aefdd68b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:41.912260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6ad0276-35be-47c7-b20d-e2f2aefdd68b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:41.912709 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6ad0276-35be-47c7-b20d-e2f2aefdd68b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:41.913470 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6ad0276-35be-47c7-b20d-e2f2aefdd68b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:41.913902 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6ad0276-35be-47c7-b20d-e2f2aefdd68b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:41.949359 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e520a727-f19a-44dd-ac98-bd6a2364d56a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:41.950173 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e520a727-f19a-44dd-ac98-bd6a2364d56a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:41.956619 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e520a727-f19a-44dd-ac98-bd6a2364d56a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:41.957066 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e520a727-f19a-44dd-ac98-bd6a2364d56a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:41.957832 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e520a727-f19a-44dd-ac98-bd6a2364d56a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:41.958264 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e520a727-f19a-44dd-ac98-bd6a2364d56a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:42.049193 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f6ad0276-35be-47c7-b20d-e2f2aefdd68b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:42.057062 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f6ad0276-35be-47c7-b20d-e2f2aefdd68b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.155854 Jun 23 16:07:42.057738 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 356/705] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:41 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:42.083582 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-abf63031-42f6-43ab-9639-03f83ee4e520 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:42.084221 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-abf63031-42f6-43ab-9639-03f83ee4e520 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:42.090555 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-abf63031-42f6-43ab-9639-03f83ee4e520 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:42.091048 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-abf63031-42f6-43ab-9639-03f83ee4e520 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:42.092522 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-abf63031-42f6-43ab-9639-03f83ee4e520 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:42.092843 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-abf63031-42f6-43ab-9639-03f83ee4e520 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:42.095312 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e520a727-f19a-44dd-ac98-bd6a2364d56a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:42.103548 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e520a727-f19a-44dd-ac98-bd6a2364d56a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:42.105081 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e520a727-f19a-44dd-ac98-bd6a2364d56a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:42.106270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e520a727-f19a-44dd-ac98-bd6a2364d56a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.161580 Jun 23 16:07:42.106853 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 350/706] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:41 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:07:42.228098 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-abf63031-42f6-43ab-9639-03f83ee4e520 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:42.235884 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-abf63031-42f6-43ab-9639-03f83ee4e520 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1365 microversion: 2.1 time: 0.156179 Jun 23 16:07:42.236465 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 357/707] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:42 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:07:43.073912 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bf5cf491-e90a-4f96-99ad-deb1e6b6eed8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:43.074521 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bf5cf491-e90a-4f96-99ad-deb1e6b6eed8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:43.076469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:43.077123 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:43.083383 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bf5cf491-e90a-4f96-99ad-deb1e6b6eed8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:43.083828 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bf5cf491-e90a-4f96-99ad-deb1e6b6eed8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:43.084585 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bf5cf491-e90a-4f96-99ad-deb1e6b6eed8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:43.085018 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bf5cf491-e90a-4f96-99ad-deb1e6b6eed8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:43.123787 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7c471308-0dbc-44e8-b404-c65c8293a3da tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:43.124393 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7c471308-0dbc-44e8-b404-c65c8293a3da tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:43.126238 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=6 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:43.132015 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c471308-0dbc-44e8-b404-c65c8293a3da tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:43.132461 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c471308-0dbc-44e8-b404-c65c8293a3da tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:43.133228 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c471308-0dbc-44e8-b404-c65c8293a3da tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:43.133662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c471308-0dbc-44e8-b404-c65c8293a3da tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:43.220335 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bf5cf491-e90a-4f96-99ad-deb1e6b6eed8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:43.228783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bf5cf491-e90a-4f96-99ad-deb1e6b6eed8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.158615 Jun 23 16:07:43.229797 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 351/708] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:43 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:43.252647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7361d247-8991-4a3c-bd24-32a8a237996f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:43.253270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7361d247-8991-4a3c-bd24-32a8a237996f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:43.259310 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7361d247-8991-4a3c-bd24-32a8a237996f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:43.259748 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7361d247-8991-4a3c-bd24-32a8a237996f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:43.260504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7361d247-8991-4a3c-bd24-32a8a237996f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:43.260939 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7361d247-8991-4a3c-bd24-32a8a237996f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:43.272629 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c471308-0dbc-44e8-b404-c65c8293a3da tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:43.281636 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c471308-0dbc-44e8-b404-c65c8293a3da tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:43.283180 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c471308-0dbc-44e8-b404-c65c8293a3da tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:43.284360 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7c471308-0dbc-44e8-b404-c65c8293a3da tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1723 microversion: 2.20 time: 0.164422 Jun 23 16:07:43.284914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 358/709] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:43 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:07:43.393483 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7361d247-8991-4a3c-bd24-32a8a237996f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:43.401549 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7361d247-8991-4a3c-bd24-32a8a237996f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1365 microversion: 2.1 time: 0.152656 Jun 23 16:07:43.402185 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 352/710] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:43 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:44.246395 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4be50bda-0a28-4025-8d81-e3baf4c30f1b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:44.247034 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4be50bda-0a28-4025-8d81-e3baf4c30f1b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:44.254310 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4be50bda-0a28-4025-8d81-e3baf4c30f1b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:44.254769 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4be50bda-0a28-4025-8d81-e3baf4c30f1b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:44.255564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4be50bda-0a28-4025-8d81-e3baf4c30f1b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:44.255998 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4be50bda-0a28-4025-8d81-e3baf4c30f1b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:44.303362 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ed841b86-2e82-4527-8301-77be3195be89 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:44.303963 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ed841b86-2e82-4527-8301-77be3195be89 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:44.310344 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ed841b86-2e82-4527-8301-77be3195be89 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:44.311387 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ed841b86-2e82-4527-8301-77be3195be89 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:44.312151 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ed841b86-2e82-4527-8301-77be3195be89 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:44.312582 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ed841b86-2e82-4527-8301-77be3195be89 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:44.398820 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ed841b86-2e82-4527-8301-77be3195be89 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:44.409035 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ed841b86-2e82-4527-8301-77be3195be89 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:44.411026 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ed841b86-2e82-4527-8301-77be3195be89 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:44.412610 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ed841b86-2e82-4527-8301-77be3195be89 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 200 len: 1656 microversion: 2.20 time: 0.113136 Jun 23 16:07:44.425142 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 353/711] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:44 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 1656 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:07:44.433596 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-2af95ebe-113a-4fee-9db1-97f13dc28060 req-1ffd9ad5-612f-4d1f-aa44-dd76c6823674 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14021a2e-8af8-4292-996e-ea87ff7752e0", "name": "network-vif-deleted", "tag": "15db635b-5851-4528-8f58-f9ba091f51a6"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:44.446270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2af95ebe-113a-4fee-9db1-97f13dc28060 req-1ffd9ad5-612f-4d1f-aa44-dd76c6823674 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:44.447248 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2af95ebe-113a-4fee-9db1-97f13dc28060 req-1ffd9ad5-612f-4d1f-aa44-dd76c6823674 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:44.456145 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4be50bda-0a28-4025-8d81-e3baf4c30f1b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:44.465574 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4be50bda-0a28-4025-8d81-e3baf4c30f1b tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.222843 Jun 23 16:07:44.466412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 359/712] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:44 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:07:44.471672 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7a573ca8-af9c-457f-a34b-f9554f831eba tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:44.472510 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7a573ca8-af9c-457f-a34b-f9554f831eba tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:44.477172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-2af95ebe-113a-4fee-9db1-97f13dc28060 req-1ffd9ad5-612f-4d1f-aa44-dd76c6823674 service nova] Creating event network-vif-deleted:15db635b-5851-4528-8f58-f9ba091f51a6 for instance 14021a2e-8af8-4292-996e-ea87ff7752e0 on hv-cinder-83538 Jun 23 16:07:44.479294 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a573ca8-af9c-457f-a34b-f9554f831eba tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:44.479749 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a573ca8-af9c-457f-a34b-f9554f831eba tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:44.480533 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a573ca8-af9c-457f-a34b-f9554f831eba tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:44.481049 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a573ca8-af9c-457f-a34b-f9554f831eba tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:44.484564 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-2af95ebe-113a-4fee-9db1-97f13dc28060 req-1ffd9ad5-612f-4d1f-aa44-dd76c6823674 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057538 Jun 23 16:07:44.485621 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 354/713] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:44.648746 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7a573ca8-af9c-457f-a34b-f9554f831eba tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:44.657940 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7a573ca8-af9c-457f-a34b-f9554f831eba tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1554 microversion: 2.1 time: 0.190146 Jun 23 16:07:44.658973 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 360/714] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:44 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1554 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:44.675460 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2654e1ef-1de7-428c-b654-a742dcc40988 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:44.676203 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2654e1ef-1de7-428c-b654-a742dcc40988 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:44.682568 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2654e1ef-1de7-428c-b654-a742dcc40988 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:44.682998 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2654e1ef-1de7-428c-b654-a742dcc40988 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:44.683761 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2654e1ef-1de7-428c-b654-a742dcc40988 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:44.684198 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2654e1ef-1de7-428c-b654-a742dcc40988 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:44.764545 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2654e1ef-1de7-428c-b654-a742dcc40988 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093327 Jun 23 16:07:44.765139 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 355/715] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 23 16:07:44 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:45.431653 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2267e1a3-6b08-4639-a318-d6e02e3249ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:45.433067 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2267e1a3-6b08-4639-a318-d6e02e3249ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:45.440192 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2267e1a3-6b08-4639-a318-d6e02e3249ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:45.441088 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2267e1a3-6b08-4639-a318-d6e02e3249ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:45.441938 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2267e1a3-6b08-4639-a318-d6e02e3249ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:45.442962 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2267e1a3-6b08-4639-a318-d6e02e3249ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:45.468406 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-2267e1a3-6b08-4639-a318-d6e02e3249ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] HTTP exception thrown: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2267e1a3-6b08-4639-a318-d6e02e3249ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Request method failure captured: Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 HTTP/1.1 Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4--x_cmhsaFHLh_ziPHArwz-3bTEMo3AcYa7FS05Xf8qqADj1L1Uin7HljAvGV2fJqAIMXdLiv8eFbYtH-9PNr3QLdjR_9HOduM-1PXX5ykXjbtCh9zXjTYtZWe_OIyULbQw-Kc7yYVeSp35eJLnwAIS3-vOiDtl4OKfMjRun3TWc Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:07:45.470099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7412ae4990fa4fe782cc4c5e3db00d75"}]}] Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: 5dd4357556944c7089efb34ee58a8e04 Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:07:45.471469 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '14021a2e-8af8-4292-996e-ea87ff7752e0'} Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:07:45.472195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:07:45.473359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:07:45.474398 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2267e1a3-6b08-4639-a318-d6e02e3249ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Returning 404 to user: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:07:45.474398 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2267e1a3-6b08-4639-a318-d6e02e3249ae tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 404 len: 111 microversion: 2.20 time: 0.043867 Jun 23 16:07:45.474398 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 361/716] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:45 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 16:07:45.483320 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d911aa77-c719-4cda-ad8d-dfdaffa4a48c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '.version_select at 0x7fe28e076790>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:45.484249 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-70fc1a51-c6ea-4482-a5f2-dd0e1f3c3b79 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:45.485162 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-70fc1a51-c6ea-4482-a5f2-dd0e1f3c3b79 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:45.493009 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-70fc1a51-c6ea-4482-a5f2-dd0e1f3c3b79 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:45.493822 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-70fc1a51-c6ea-4482-a5f2-dd0e1f3c3b79 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:45.494937 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-70fc1a51-c6ea-4482-a5f2-dd0e1f3c3b79 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:45.495432 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-70fc1a51-c6ea-4482-a5f2-dd0e1f3c3b79 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:45.512483 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d911aa77-c719-4cda-ad8d-dfdaffa4a48c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689879792" status: 204 len: 0 microversion: 2.20 time: 0.034765 Jun 23 16:07:45.513067 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 356/717] 10.222.0.46 () {60 vars in 1261 bytes} [Thu Jun 23 16:07:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689879792 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 16:07:45.693911 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-70fc1a51-c6ea-4482-a5f2-dd0e1f3c3b79 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:45.703931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-70fc1a51-c6ea-4482-a5f2-dd0e1f3c3b79 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.223911 Jun 23 16:07:45.704512 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 362/718] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:45 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:45.759949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-812c8dc2-4eb5-4741-bc96-5ab1b4bedfb0 req-1018c5f3-8e8d-4321-9407-ec09e371d280 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c3b97d-6f9a-4ce8-8081-dd5903a13761", "tag": "db91a74b-77fc-40fb-bf12-5e5899ebd3e2"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:45.778438 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-812c8dc2-4eb5-4741-bc96-5ab1b4bedfb0 req-1018c5f3-8e8d-4321-9407-ec09e371d280 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:45.779180 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-812c8dc2-4eb5-4741-bc96-5ab1b4bedfb0 req-1018c5f3-8e8d-4321-9407-ec09e371d280 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:45.796521 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-812c8dc2-4eb5-4741-bc96-5ab1b4bedfb0 req-1018c5f3-8e8d-4321-9407-ec09e371d280 service nova] Creating event network-changed:db91a74b-77fc-40fb-bf12-5e5899ebd3e2 for instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 on hv-cinder-83538 Jun 23 16:07:45.802090 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-812c8dc2-4eb5-4741-bc96-5ab1b4bedfb0 req-1018c5f3-8e8d-4321-9407-ec09e371d280 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046456 Jun 23 16:07:45.803434 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 357/719] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:46.271938 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ccd2e086-d850-4be2-9c06-3e6384455c94 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Action: 'create', calling method: .version_select at 0x7fe28d3bc9d0>, body: {"keypair": {"name": "tempest-keypair-861550779", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECNf0Xa0XGGSdZUPtzj5qCKZ2C9s6KJaO5W3FijyJMPDJWIG36YXl6MwB95yUKMrHD1UILk8fg74nCqPHJo2DF18kpCcKMLoF3LCmqATX4vOjjss79X7KwUVtyrDiudsA=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:46.287924 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-ccd2e086-d850-4be2-9c06-3e6384455c94 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Getting quotas for project 7412ae4990fa4fe782cc4c5e3db00d75. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:07:46.292202 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-ccd2e086-d850-4be2-9c06-3e6384455c94 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Getting quotas for user 5dd4357556944c7089efb34ee58a8e04 and project 7412ae4990fa4fe782cc4c5e3db00d75. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:07:46.317111 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ccd2e086-d850-4be2-9c06-3e6384455c94 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.049029 Jun 23 16:07:46.318563 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 363/720] 10.222.0.46 () {62 vars in 1199 bytes} [Thu Jun 23 16:07:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 16:07:46.722016 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-91685d78-2a09-460d-8b27-7111e0492222 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:46.722735 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-91685d78-2a09-460d-8b27-7111e0492222 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:46.730340 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-91685d78-2a09-460d-8b27-7111e0492222 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:46.731127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-91685d78-2a09-460d-8b27-7111e0492222 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:46.731906 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-91685d78-2a09-460d-8b27-7111e0492222 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:46.732342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-91685d78-2a09-460d-8b27-7111e0492222 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:46.878996 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-91685d78-2a09-460d-8b27-7111e0492222 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:46.887108 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-91685d78-2a09-460d-8b27-7111e0492222 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.169251 Jun 23 16:07:46.887791 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 358/721] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:46 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:47.616261 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-490240662", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "780de197-01bd-4423-a125-1dd611f3e7a3"}], "security_groups": [{"name": "tempest-securitygroup--1381397013"}], "key_name": "tempest-keypair-861550779", "user_data": "}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:47.715895 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] validate_networks() for [('780de197-01bd-4423-a125-1dd611f3e7a3', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:07:47.905891 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b404b19a-4097-484c-98e5-674b8fcbeb19 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:47.906890 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b404b19a-4097-484c-98e5-674b8fcbeb19 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:47.913107 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b404b19a-4097-484c-98e5-674b8fcbeb19 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:47.913542 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b404b19a-4097-484c-98e5-674b8fcbeb19 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:47.914290 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b404b19a-4097-484c-98e5-674b8fcbeb19 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:47.914732 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b404b19a-4097-484c-98e5-674b8fcbeb19 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:48.047709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b404b19a-4097-484c-98e5-674b8fcbeb19 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:48.055218 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b404b19a-4097-484c-98e5-674b8fcbeb19 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.153733 Jun 23 16:07:48.055782 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 359/722] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:47 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:07:48.132952 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:07:48.133366 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:07:48.133836 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:07:48.134245 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:07:48.134670 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:07:48.144013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:48.144458 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:48.145250 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:48.145685 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:48.162714 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Getting quotas for project 7412ae4990fa4fe782cc4c5e3db00d75. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:07:48.166700 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Getting quotas for user 5dd4357556944c7089efb34ee58a8e04 and project 7412ae4990fa4fe782cc4c5e3db00d75. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:07:48.168984 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:48.179374 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:07:48.181622 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:07:48.227421 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b2da7ce0-42e8-4218-9647-c37df5fc02cc tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.616036 Jun 23 16:07:48.228063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 364/723] 10.222.0.46 () {62 vars in 1187 bytes} [Thu Jun 23 16:07:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 16:07:48.238810 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ae465476-22a4-4e81-ada7-d4c99bc0e8a5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:48.239378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ae465476-22a4-4e81-ada7-d4c99bc0e8a5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:48.247615 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:48.296720 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ae465476-22a4-4e81-ada7-d4c99bc0e8a5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:48.303740 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ae465476-22a4-4e81-ada7-d4c99bc0e8a5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:48.305231 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ae465476-22a4-4e81-ada7-d4c99bc0e8a5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:48.306331 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ae465476-22a4-4e81-ada7-d4c99bc0e8a5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1280 microversion: 2.20 time: 0.071781 Jun 23 16:07:48.306909 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 360/724] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:48 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:07:49.072972 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6d783adc-9d30-442e-80c8-540931b5ad1e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:49.073508 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6d783adc-9d30-442e-80c8-540931b5ad1e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:49.080242 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d783adc-9d30-442e-80c8-540931b5ad1e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:49.080686 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d783adc-9d30-442e-80c8-540931b5ad1e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:49.081443 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d783adc-9d30-442e-80c8-540931b5ad1e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:49.081871 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6d783adc-9d30-442e-80c8-540931b5ad1e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:49.238257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6d783adc-9d30-442e-80c8-540931b5ad1e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:49.246372 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6d783adc-9d30-442e-80c8-540931b5ad1e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.177955 Jun 23 16:07:49.247324 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 365/725] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:49 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:49.325355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-16a9a00b-8c9b-4eb0-93df-97528c8c0bd0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:49.325993 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-16a9a00b-8c9b-4eb0-93df-97528c8c0bd0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:49.332926 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16a9a00b-8c9b-4eb0-93df-97528c8c0bd0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:49.333413 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16a9a00b-8c9b-4eb0-93df-97528c8c0bd0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:49.334866 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16a9a00b-8c9b-4eb0-93df-97528c8c0bd0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:49.335302 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-16a9a00b-8c9b-4eb0-93df-97528c8c0bd0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:49.403156 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-16a9a00b-8c9b-4eb0-93df-97528c8c0bd0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:49.411537 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-16a9a00b-8c9b-4eb0-93df-97528c8c0bd0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:49.413021 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-16a9a00b-8c9b-4eb0-93df-97528c8c0bd0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:49.414104 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-16a9a00b-8c9b-4eb0-93df-97528c8c0bd0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1338 microversion: 2.20 time: 0.093141 Jun 23 16:07:49.414645 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 361/726] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:49 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1338 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:07:50.265542 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6be6f3d8-5f8d-4bbb-a084-b75b48c7fac5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:50.266323 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6be6f3d8-5f8d-4bbb-a084-b75b48c7fac5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:50.273513 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6be6f3d8-5f8d-4bbb-a084-b75b48c7fac5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:50.274100 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6be6f3d8-5f8d-4bbb-a084-b75b48c7fac5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:50.275010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6be6f3d8-5f8d-4bbb-a084-b75b48c7fac5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:50.275549 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6be6f3d8-5f8d-4bbb-a084-b75b48c7fac5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:50.433907 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1bb73ab4-3d0f-45ef-8201-b781e637bb37 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:50.435194 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1bb73ab4-3d0f-45ef-8201-b781e637bb37 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:50.441995 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bb73ab4-3d0f-45ef-8201-b781e637bb37 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:50.442435 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bb73ab4-3d0f-45ef-8201-b781e637bb37 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:50.443551 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bb73ab4-3d0f-45ef-8201-b781e637bb37 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:50.443984 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bb73ab4-3d0f-45ef-8201-b781e637bb37 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:50.542629 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6be6f3d8-5f8d-4bbb-a084-b75b48c7fac5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:50.553279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6be6f3d8-5f8d-4bbb-a084-b75b48c7fac5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.291759 Jun 23 16:07:50.555023 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 366/727] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:50 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:50.607082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1bb73ab4-3d0f-45ef-8201-b781e637bb37 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:50.616172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1bb73ab4-3d0f-45ef-8201-b781e637bb37 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:50.617675 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1bb73ab4-3d0f-45ef-8201-b781e637bb37 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:50.618813 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1bb73ab4-3d0f-45ef-8201-b781e637bb37 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1406 microversion: 2.20 time: 0.190077 Jun 23 16:07:50.619635 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 362/728] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:50 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:07:50.995701 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-adf39fd9-adbe-4005-bdd7-75bfa7d2a38a req-7097cad5-e09c-473c-8de0-eb96b1867a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7563514-d6f1-44c1-b8ae-7008e842faf8", "tag": "afe54005-6126-4438-ba09-6763f07e66d9"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:51.004663 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-adf39fd9-adbe-4005-bdd7-75bfa7d2a38a req-7097cad5-e09c-473c-8de0-eb96b1867a58 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:51.005121 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-adf39fd9-adbe-4005-bdd7-75bfa7d2a38a req-7097cad5-e09c-473c-8de0-eb96b1867a58 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:51.019744 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-adf39fd9-adbe-4005-bdd7-75bfa7d2a38a req-7097cad5-e09c-473c-8de0-eb96b1867a58 service nova] Creating event network-changed:afe54005-6126-4438-ba09-6763f07e66d9 for instance b7563514-d6f1-44c1-b8ae-7008e842faf8 on hv-cinder-83538 Jun 23 16:07:51.025140 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-adf39fd9-adbe-4005-bdd7-75bfa7d2a38a req-7097cad5-e09c-473c-8de0-eb96b1867a58 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034814 Jun 23 16:07:51.029683 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 367/729] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:07:51.571600 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-48d8103d-f519-4a37-8936-9275df42b2bf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:51.572113 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-48d8103d-f519-4a37-8936-9275df42b2bf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:51.579922 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-48d8103d-f519-4a37-8936-9275df42b2bf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:51.580400 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-48d8103d-f519-4a37-8936-9275df42b2bf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:51.581168 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-48d8103d-f519-4a37-8936-9275df42b2bf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:51.581625 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-48d8103d-f519-4a37-8936-9275df42b2bf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:51.638066 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bfd8cc0d-da89-430f-8b4d-c5c775bcc779 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:51.639394 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bfd8cc0d-da89-430f-8b4d-c5c775bcc779 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:51.645631 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bfd8cc0d-da89-430f-8b4d-c5c775bcc779 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:51.646076 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bfd8cc0d-da89-430f-8b4d-c5c775bcc779 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:51.646871 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bfd8cc0d-da89-430f-8b4d-c5c775bcc779 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:51.647311 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bfd8cc0d-da89-430f-8b4d-c5c775bcc779 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:51.714126 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-48d8103d-f519-4a37-8936-9275df42b2bf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:51.722824 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-48d8103d-f519-4a37-8936-9275df42b2bf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.155009 Jun 23 16:07:51.723632 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 363/730] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:51 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:51.782621 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bfd8cc0d-da89-430f-8b4d-c5c775bcc779 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:51.790546 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bfd8cc0d-da89-430f-8b4d-c5c775bcc779 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:51.792060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bfd8cc0d-da89-430f-8b4d-c5c775bcc779 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:51.793155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bfd8cc0d-da89-430f-8b4d-c5c775bcc779 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1406 microversion: 2.20 time: 0.159828 Jun 23 16:07:51.793704 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 368/731] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:51 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:07:52.741065 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4a235719-4ceb-434e-9235-2a0fb9e4bc8e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:52.741640 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4a235719-4ceb-434e-9235-2a0fb9e4bc8e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:52.747813 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a235719-4ceb-434e-9235-2a0fb9e4bc8e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:52.748250 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a235719-4ceb-434e-9235-2a0fb9e4bc8e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:52.748994 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a235719-4ceb-434e-9235-2a0fb9e4bc8e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:52.749418 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4a235719-4ceb-434e-9235-2a0fb9e4bc8e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:52.767662 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:52.812538 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-713b94ed-5242-4093-b9ea-17de00f59940 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:52.813227 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-713b94ed-5242-4093-b9ea-17de00f59940 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:52.820810 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-713b94ed-5242-4093-b9ea-17de00f59940 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:52.821262 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-713b94ed-5242-4093-b9ea-17de00f59940 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:52.822085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-713b94ed-5242-4093-b9ea-17de00f59940 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:52.822522 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-713b94ed-5242-4093-b9ea-17de00f59940 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:52.900061 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4a235719-4ceb-434e-9235-2a0fb9e4bc8e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:52.907947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4a235719-4ceb-434e-9235-2a0fb9e4bc8e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1568 microversion: 2.1 time: 0.170842 Jun 23 16:07:52.920994 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 364/732] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:52 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:52.927905 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e72f2bd6-b4d0-49f6-a9f1-509035b8b445 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:52.928730 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e72f2bd6-b4d0-49f6-a9f1-509035b8b445 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:52.935813 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e72f2bd6-b4d0-49f6-a9f1-509035b8b445 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:52.936346 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e72f2bd6-b4d0-49f6-a9f1-509035b8b445 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:52.937188 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e72f2bd6-b4d0-49f6-a9f1-509035b8b445 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:52.937695 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e72f2bd6-b4d0-49f6-a9f1-509035b8b445 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:52.973426 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-713b94ed-5242-4093-b9ea-17de00f59940 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:52.981727 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-713b94ed-5242-4093-b9ea-17de00f59940 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:52.983331 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-713b94ed-5242-4093-b9ea-17de00f59940 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:52.984545 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-713b94ed-5242-4093-b9ea-17de00f59940 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1406 microversion: 2.20 time: 0.176626 Jun 23 16:07:52.985096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 369/733] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:52 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:07:53.014930 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e72f2bd6-b4d0-49f6-a9f1-509035b8b445 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "POST /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c/action" status: 202 len: 0 microversion: 2.1 time: 0.092165 Jun 23 16:07:53.015798 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 365/734] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:07:52 2022] POST /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:07:53.024053 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7d83a6e4-f677-41bf-82d7-73579d96bc45 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:53.024669 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7d83a6e4-f677-41bf-82d7-73579d96bc45 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:53.031073 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d83a6e4-f677-41bf-82d7-73579d96bc45 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:53.031522 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d83a6e4-f677-41bf-82d7-73579d96bc45 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:53.032295 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d83a6e4-f677-41bf-82d7-73579d96bc45 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:53.032727 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d83a6e4-f677-41bf-82d7-73579d96bc45 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:53.204060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7d83a6e4-f677-41bf-82d7-73579d96bc45 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:53.211625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7d83a6e4-f677-41bf-82d7-73579d96bc45 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1516 microversion: 2.1 time: 0.191679 Jun 23 16:07:53.212194 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 370/735] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:53 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1516 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:54.004411 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0fa03d71-d8ec-464a-bd08-9e02f5de877d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:54.005024 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0fa03d71-d8ec-464a-bd08-9e02f5de877d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:54.011099 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0fa03d71-d8ec-464a-bd08-9e02f5de877d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:54.011542 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0fa03d71-d8ec-464a-bd08-9e02f5de877d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:54.012313 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0fa03d71-d8ec-464a-bd08-9e02f5de877d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:54.012741 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0fa03d71-d8ec-464a-bd08-9e02f5de877d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:54.141064 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0fa03d71-d8ec-464a-bd08-9e02f5de877d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:54.149213 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0fa03d71-d8ec-464a-bd08-9e02f5de877d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:54.150742 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0fa03d71-d8ec-464a-bd08-9e02f5de877d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:54.151855 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0fa03d71-d8ec-464a-bd08-9e02f5de877d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1406 microversion: 2.20 time: 0.151950 Jun 23 16:07:54.152411 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 366/736] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:53 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:07:54.228198 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3d427969-1a25-4ce5-82ea-ce3a10528d36 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:54.228815 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3d427969-1a25-4ce5-82ea-ce3a10528d36 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:54.235860 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d427969-1a25-4ce5-82ea-ce3a10528d36 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:54.236313 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d427969-1a25-4ce5-82ea-ce3a10528d36 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:54.237075 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d427969-1a25-4ce5-82ea-ce3a10528d36 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:54.237511 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d427969-1a25-4ce5-82ea-ce3a10528d36 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:54.373494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-3d427969-1a25-4ce5-82ea-ce3a10528d36 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:54.381021 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3d427969-1a25-4ce5-82ea-ce3a10528d36 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1516 microversion: 2.1 time: 0.156677 Jun 23 16:07:54.381592 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 371/737] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:54 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:55.170104 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-03cae220-f049-4463-b650-644379b04272 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:55.170719 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-03cae220-f049-4463-b650-644379b04272 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:55.177258 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03cae220-f049-4463-b650-644379b04272 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:55.177703 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03cae220-f049-4463-b650-644379b04272 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:55.178455 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03cae220-f049-4463-b650-644379b04272 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:55.178928 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03cae220-f049-4463-b650-644379b04272 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:55.304932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-03cae220-f049-4463-b650-644379b04272 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:55.313538 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-03cae220-f049-4463-b650-644379b04272 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:55.315122 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-03cae220-f049-4463-b650-644379b04272 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:55.316233 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-03cae220-f049-4463-b650-644379b04272 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1406 microversion: 2.20 time: 0.150071 Jun 23 16:07:55.316793 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 367/738] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:55 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:07:55.397282 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-30e490bd-035a-48d7-ba48-863f7c0c504d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:55.397889 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-30e490bd-035a-48d7-ba48-863f7c0c504d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:55.405183 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30e490bd-035a-48d7-ba48-863f7c0c504d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:55.405632 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30e490bd-035a-48d7-ba48-863f7c0c504d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:55.406398 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30e490bd-035a-48d7-ba48-863f7c0c504d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:55.406859 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-30e490bd-035a-48d7-ba48-863f7c0c504d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:55.534844 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-497b0023-11a4-447b-ab4c-16e410cac827 req-67af53d6-e05b-4d8c-8318-ab877701c825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d20925-62c2-42d3-9cd4-87cafcfcb78c", "name": "network-vif-unplugged", "status": "completed", "tag": "a2b7418c-7a16-44c2-9376-785b79ce1926"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:55.550864 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-497b0023-11a4-447b-ab4c-16e410cac827 req-67af53d6-e05b-4d8c-8318-ab877701c825 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:55.559289 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-497b0023-11a4-447b-ab4c-16e410cac827 req-67af53d6-e05b-4d8c-8318-ab877701c825 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:55.586649 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.compute.server_external_events [req-497b0023-11a4-447b-ab4c-16e410cac827 req-67af53d6-e05b-4d8c-8318-ab877701c825 service nova] Unable to find a host for instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c. Dropping event network-vif-unplugged {{(pid=117891) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 16:07:55.587643 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-497b0023-11a4-447b-ab4c-16e410cac827 req-67af53d6-e05b-4d8c-8318-ab877701c825 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.060503 Jun 23 16:07:55.589227 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 368/739] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 63 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 16:07:55.611523 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-30e490bd-035a-48d7-ba48-863f7c0c504d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:55.615039 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:55.620704 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-30e490bd-035a-48d7-ba48-863f7c0c504d tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1516 microversion: 2.1 time: 0.227307 Jun 23 16:07:55.621286 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 372/740] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:55 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1516 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:56.334673 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-915c24bf-2075-4a9b-86f3-a22e15236082 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:56.335456 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-915c24bf-2075-4a9b-86f3-a22e15236082 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:56.342613 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-915c24bf-2075-4a9b-86f3-a22e15236082 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:56.343084 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-915c24bf-2075-4a9b-86f3-a22e15236082 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:56.343846 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-915c24bf-2075-4a9b-86f3-a22e15236082 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:56.344308 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-915c24bf-2075-4a9b-86f3-a22e15236082 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:56.475671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-915c24bf-2075-4a9b-86f3-a22e15236082 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:56.483502 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-915c24bf-2075-4a9b-86f3-a22e15236082 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:56.485004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-915c24bf-2075-4a9b-86f3-a22e15236082 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:56.486112 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-915c24bf-2075-4a9b-86f3-a22e15236082 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1406 microversion: 2.20 time: 0.155368 Jun 23 16:07:56.486670 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 369/741] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:56 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:07:56.638854 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-69b73b5d-2307-423f-9b35-39683d723d9e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:56.639466 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-69b73b5d-2307-423f-9b35-39683d723d9e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:56.645947 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-69b73b5d-2307-423f-9b35-39683d723d9e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:56.646400 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-69b73b5d-2307-423f-9b35-39683d723d9e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:56.647200 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-69b73b5d-2307-423f-9b35-39683d723d9e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:56.647634 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-69b73b5d-2307-423f-9b35-39683d723d9e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:56.777954 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-69b73b5d-2307-423f-9b35-39683d723d9e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:56.785511 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-69b73b5d-2307-423f-9b35-39683d723d9e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1518 microversion: 2.1 time: 0.151127 Jun 23 16:07:56.786079 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 373/742] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:56 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:57.504414 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-84cc0229-82a3-4118-a47c-7c0f4793bd11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:57.505080 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-84cc0229-82a3-4118-a47c-7c0f4793bd11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:57.512226 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84cc0229-82a3-4118-a47c-7c0f4793bd11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:57.513664 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84cc0229-82a3-4118-a47c-7c0f4793bd11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:57.514851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84cc0229-82a3-4118-a47c-7c0f4793bd11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:57.515383 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-84cc0229-82a3-4118-a47c-7c0f4793bd11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:57.622471 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-cc3adc37-b4cb-4ff9-901b-45448fc80d26 req-0df1a2bd-ee68-4d5d-bb49-b3e2e795564f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7563514-d6f1-44c1-b8ae-7008e842faf8", "name": "network-vif-plugged", "status": "completed", "tag": "afe54005-6126-4438-ba09-6763f07e66d9"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:07:57.633915 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-cc3adc37-b4cb-4ff9-901b-45448fc80d26 req-0df1a2bd-ee68-4d5d-bb49-b3e2e795564f service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:57.634867 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-cc3adc37-b4cb-4ff9-901b-45448fc80d26 req-0df1a2bd-ee68-4d5d-bb49-b3e2e795564f service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:57.654305 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-cc3adc37-b4cb-4ff9-901b-45448fc80d26 req-0df1a2bd-ee68-4d5d-bb49-b3e2e795564f service nova] Creating event network-vif-plugged:afe54005-6126-4438-ba09-6763f07e66d9 for instance b7563514-d6f1-44c1-b8ae-7008e842faf8 on hv-cinder-83538 Jun 23 16:07:57.662035 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-cc3adc37-b4cb-4ff9-901b-45448fc80d26 req-0df1a2bd-ee68-4d5d-bb49-b3e2e795564f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044211 Jun 23 16:07:57.663740 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 374/743] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:07:57.665434 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-84cc0229-82a3-4118-a47c-7c0f4793bd11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:57.676305 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-84cc0229-82a3-4118-a47c-7c0f4793bd11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:57.678731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-84cc0229-82a3-4118-a47c-7c0f4793bd11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:57.680355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-84cc0229-82a3-4118-a47c-7c0f4793bd11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1406 microversion: 2.20 time: 0.179813 Jun 23 16:07:57.681146 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 370/744] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:57 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:07:57.803127 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-96703acc-af21-43e1-8883-be2dc5565cc8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:57.803816 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-96703acc-af21-43e1-8883-be2dc5565cc8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:57.810255 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96703acc-af21-43e1-8883-be2dc5565cc8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:57.810739 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96703acc-af21-43e1-8883-be2dc5565cc8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:57.811591 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96703acc-af21-43e1-8883-be2dc5565cc8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:57.812100 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-96703acc-af21-43e1-8883-be2dc5565cc8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:58.024033 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-96703acc-af21-43e1-8883-be2dc5565cc8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:58.032430 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-96703acc-af21-43e1-8883-be2dc5565cc8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.233521 Jun 23 16:07:58.032989 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 375/745] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:57 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:07:58.697947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-abf38575-f450-43c3-a9c8-2871775af1e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:58.698556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-abf38575-f450-43c3-a9c8-2871775af1e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:58.700392 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:58.706246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abf38575-f450-43c3-a9c8-2871775af1e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:58.706684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abf38575-f450-43c3-a9c8-2871775af1e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:58.707470 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abf38575-f450-43c3-a9c8-2871775af1e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:58.707896 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-abf38575-f450-43c3-a9c8-2871775af1e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:58.837494 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-abf38575-f450-43c3-a9c8-2871775af1e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:58.845952 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-abf38575-f450-43c3-a9c8-2871775af1e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:58.847496 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-abf38575-f450-43c3-a9c8-2871775af1e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:58.848607 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-abf38575-f450-43c3-a9c8-2871775af1e1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1406 microversion: 2.20 time: 0.154519 Jun 23 16:07:58.849162 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 371/746] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:58 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:07:59.049919 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7e4b921e-0660-42fe-acca-8ac1f99e112c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:59.050535 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7e4b921e-0660-42fe-acca-8ac1f99e112c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:59.052808 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:59.053464 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=10 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:07:59.060619 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e4b921e-0660-42fe-acca-8ac1f99e112c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:59.061070 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e4b921e-0660-42fe-acca-8ac1f99e112c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:59.061834 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e4b921e-0660-42fe-acca-8ac1f99e112c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:59.062274 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e4b921e-0660-42fe-acca-8ac1f99e112c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:59.196781 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7e4b921e-0660-42fe-acca-8ac1f99e112c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:07:59.204864 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7e4b921e-0660-42fe-acca-8ac1f99e112c tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.158867 Jun 23 16:07:59.205420 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 376/747] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:07:59 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:07:59.866663 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-70b1f634-08f0-4db7-8922-709cf9c0b6fe tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:07:59.867303 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-70b1f634-08f0-4db7-8922-709cf9c0b6fe tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:07:59.874313 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-70b1f634-08f0-4db7-8922-709cf9c0b6fe tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:59.874794 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-70b1f634-08f0-4db7-8922-709cf9c0b6fe tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:07:59.875547 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-70b1f634-08f0-4db7-8922-709cf9c0b6fe tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:07:59.875981 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-70b1f634-08f0-4db7-8922-709cf9c0b6fe tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:00.003146 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-70b1f634-08f0-4db7-8922-709cf9c0b6fe tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:00.010990 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-70b1f634-08f0-4db7-8922-709cf9c0b6fe tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:00.012470 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-70b1f634-08f0-4db7-8922-709cf9c0b6fe tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:00.013556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-70b1f634-08f0-4db7-8922-709cf9c0b6fe tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1406 microversion: 2.20 time: 0.150844 Jun 23 16:08:00.014103 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 372/748] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:07:59 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:08:00.221602 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-09eb8f0e-b3ba-4e78-a066-b495e677be92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:00.222143 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-09eb8f0e-b3ba-4e78-a066-b495e677be92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:00.228666 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-09eb8f0e-b3ba-4e78-a066-b495e677be92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:00.229113 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-09eb8f0e-b3ba-4e78-a066-b495e677be92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:00.229875 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-09eb8f0e-b3ba-4e78-a066-b495e677be92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:00.230315 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-09eb8f0e-b3ba-4e78-a066-b495e677be92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:00.366322 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-09eb8f0e-b3ba-4e78-a066-b495e677be92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:00.374032 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-09eb8f0e-b3ba-4e78-a066-b495e677be92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.156382 Jun 23 16:08:00.374595 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 377/749] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:00 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:01.032204 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d8336d47-0034-4c09-a330-9b0089868ef9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:01.032793 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d8336d47-0034-4c09-a330-9b0089868ef9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:01.039300 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d8336d47-0034-4c09-a330-9b0089868ef9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:01.039747 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d8336d47-0034-4c09-a330-9b0089868ef9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:01.040510 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d8336d47-0034-4c09-a330-9b0089868ef9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:01.040938 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d8336d47-0034-4c09-a330-9b0089868ef9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:01.173857 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d8336d47-0034-4c09-a330-9b0089868ef9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:01.181671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d8336d47-0034-4c09-a330-9b0089868ef9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:01.183178 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d8336d47-0034-4c09-a330-9b0089868ef9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:01.184343 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d8336d47-0034-4c09-a330-9b0089868ef9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1599 microversion: 2.20 time: 0.156589 Jun 23 16:08:01.185397 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 373/750] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:08:01 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:08:01.209421 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8b6157fa-4179-4d5a-9b54-5be25486b38f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:01.209845 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8b6157fa-4179-4d5a-9b54-5be25486b38f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:01.216256 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8b6157fa-4179-4d5a-9b54-5be25486b38f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:01.216711 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8b6157fa-4179-4d5a-9b54-5be25486b38f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:01.217463 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8b6157fa-4179-4d5a-9b54-5be25486b38f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:01.217886 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8b6157fa-4179-4d5a-9b54-5be25486b38f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:01.294862 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8b6157fa-4179-4d5a-9b54-5be25486b38f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096589 Jun 23 16:08:01.295466 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 378/751] 10.222.0.46 () {60 vars in 1315 bytes} [Thu Jun 23 16:08:01 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 16:08:01.391632 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1d097b2e-cb00-44a6-b849-20e3a60a4c92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:01.392239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1d097b2e-cb00-44a6-b849-20e3a60a4c92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:01.398436 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d097b2e-cb00-44a6-b849-20e3a60a4c92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:01.398948 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d097b2e-cb00-44a6-b849-20e3a60a4c92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:01.399730 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d097b2e-cb00-44a6-b849-20e3a60a4c92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:01.400160 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1d097b2e-cb00-44a6-b849-20e3a60a4c92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:01.530631 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1d097b2e-cb00-44a6-b849-20e3a60a4c92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:01.538406 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1d097b2e-cb00-44a6-b849-20e3a60a4c92 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.151310 Jun 23 16:08:01.539002 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 374/752] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:01 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:02.458956 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-c84d223d-97d1-45f6-b8cb-424f2dc59848 req-81d36b4f-1dd0-4f34-8de9-4fc22efc19d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7563514-d6f1-44c1-b8ae-7008e842faf8", "tag": "afe54005-6126-4438-ba09-6763f07e66d9"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:02.467610 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-c84d223d-97d1-45f6-b8cb-424f2dc59848 req-81d36b4f-1dd0-4f34-8de9-4fc22efc19d3 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:02.468059 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-c84d223d-97d1-45f6-b8cb-424f2dc59848 req-81d36b4f-1dd0-4f34-8de9-4fc22efc19d3 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:02.479084 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-c84d223d-97d1-45f6-b8cb-424f2dc59848 req-81d36b4f-1dd0-4f34-8de9-4fc22efc19d3 service nova] Creating event network-changed:afe54005-6126-4438-ba09-6763f07e66d9 for instance b7563514-d6f1-44c1-b8ae-7008e842faf8 on hv-cinder-83538 Jun 23 16:08:02.483902 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-c84d223d-97d1-45f6-b8cb-424f2dc59848 req-81d36b4f-1dd0-4f34-8de9-4fc22efc19d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029113 Jun 23 16:08:02.484501 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 379/753] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:08:02.555854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-42e312ae-869a-4ade-9627-30b194c1cce8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:02.556626 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-42e312ae-869a-4ade-9627-30b194c1cce8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:02.564238 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-42e312ae-869a-4ade-9627-30b194c1cce8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:02.564608 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-42e312ae-869a-4ade-9627-30b194c1cce8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:02.565374 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-42e312ae-869a-4ade-9627-30b194c1cce8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:02.565805 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-42e312ae-869a-4ade-9627-30b194c1cce8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:02.708962 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-42e312ae-869a-4ade-9627-30b194c1cce8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:02.717249 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-42e312ae-869a-4ade-9627-30b194c1cce8 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.165233 Jun 23 16:08:02.718067 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 375/754] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:02 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:03.735485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-382c9d0f-6d32-4d2e-adce-8c2df2883716 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:03.736184 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-382c9d0f-6d32-4d2e-adce-8c2df2883716 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:03.742490 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-382c9d0f-6d32-4d2e-adce-8c2df2883716 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:03.742968 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-382c9d0f-6d32-4d2e-adce-8c2df2883716 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:03.743730 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-382c9d0f-6d32-4d2e-adce-8c2df2883716 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:03.744167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-382c9d0f-6d32-4d2e-adce-8c2df2883716 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:03.880968 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-382c9d0f-6d32-4d2e-adce-8c2df2883716 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:03.889001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-382c9d0f-6d32-4d2e-adce-8c2df2883716 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.158222 Jun 23 16:08:03.889571 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 380/755] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:03 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:04.906198 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6688a4c4-c934-4702-ad11-55c9c991d6cf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:04.906826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6688a4c4-c934-4702-ad11-55c9c991d6cf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:04.913361 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6688a4c4-c934-4702-ad11-55c9c991d6cf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:04.913793 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6688a4c4-c934-4702-ad11-55c9c991d6cf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:04.914534 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6688a4c4-c934-4702-ad11-55c9c991d6cf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:04.914995 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6688a4c4-c934-4702-ad11-55c9c991d6cf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:05.051548 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6688a4c4-c934-4702-ad11-55c9c991d6cf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:05.058927 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6688a4c4-c934-4702-ad11-55c9c991d6cf tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.156563 Jun 23 16:08:05.059481 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 376/756] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:04 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:06.076405 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c3f3b639-221f-49c5-ad21-339372198873 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:06.077019 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c3f3b639-221f-49c5-ad21-339372198873 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:06.083604 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c3f3b639-221f-49c5-ad21-339372198873 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:06.084051 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c3f3b639-221f-49c5-ad21-339372198873 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:06.084819 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c3f3b639-221f-49c5-ad21-339372198873 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:06.085257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c3f3b639-221f-49c5-ad21-339372198873 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:06.215493 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c3f3b639-221f-49c5-ad21-339372198873 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:06.223843 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c3f3b639-221f-49c5-ad21-339372198873 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.151869 Jun 23 16:08:06.224405 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 381/757] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:06 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:06.410025 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-07517f8a-7e27-4b8e-8f2d-142e5aac6a21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:06.410528 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-07517f8a-7e27-4b8e-8f2d-142e5aac6a21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:06.416968 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07517f8a-7e27-4b8e-8f2d-142e5aac6a21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:06.417402 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07517f8a-7e27-4b8e-8f2d-142e5aac6a21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:06.418145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07517f8a-7e27-4b8e-8f2d-142e5aac6a21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:06.418569 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-07517f8a-7e27-4b8e-8f2d-142e5aac6a21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:06.496158 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-07517f8a-7e27-4b8e-8f2d-142e5aac6a21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lazy-loading 'services' on Instance uuid 649b033e-63c2-44c2-a597-4192007bb977 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:08:06.573346 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-07517f8a-7e27-4b8e-8f2d-142e5aac6a21 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments/c9a37c63-f49b-4202-8532-27652b689bec" status: 202 len: 0 microversion: 2.1 time: 0.167055 Jun 23 16:08:06.574122 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 377/758] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 23 16:08:06 2022] DELETE /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments/c9a37c63-f49b-4202-8532-27652b689bec => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:08:06.584243 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-07042f8f-6b4e-4064-abf5-b513ba8025f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:06.585201 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-07042f8f-6b4e-4064-abf5-b513ba8025f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:06.591536 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07042f8f-6b4e-4064-abf5-b513ba8025f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:06.592008 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07042f8f-6b4e-4064-abf5-b513ba8025f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:06.592849 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07042f8f-6b4e-4064-abf5-b513ba8025f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:06.593362 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-07042f8f-6b4e-4064-abf5-b513ba8025f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:06.629995 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-07042f8f-6b4e-4064-abf5-b513ba8025f8 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050848 Jun 23 16:08:06.630558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 382/759] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:08:06 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:08:07.242274 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-87064d96-4693-4900-a7c0-af26497b25af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:07.242908 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-87064d96-4693-4900-a7c0-af26497b25af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:07.249264 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-87064d96-4693-4900-a7c0-af26497b25af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:07.249706 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-87064d96-4693-4900-a7c0-af26497b25af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:07.250455 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-87064d96-4693-4900-a7c0-af26497b25af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:07.250917 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-87064d96-4693-4900-a7c0-af26497b25af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:07.386138 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-87064d96-4693-4900-a7c0-af26497b25af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:07.395487 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-87064d96-4693-4900-a7c0-af26497b25af tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.157480 Jun 23 16:08:07.396072 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 378/760] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:07 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:07.605554 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-42129cd5-b762-4811-a319-58395678440f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:07.607028 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-42129cd5-b762-4811-a319-58395678440f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:07.622029 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-42129cd5-b762-4811-a319-58395678440f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:07.622484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-42129cd5-b762-4811-a319-58395678440f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:07.623298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-42129cd5-b762-4811-a319-58395678440f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:07.623737 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-42129cd5-b762-4811-a319-58395678440f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:07.642955 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5305c7bf-72a3-4b6e-b057-d164af9c0cce tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:07.644048 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5305c7bf-72a3-4b6e-b057-d164af9c0cce tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:07.651504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5305c7bf-72a3-4b6e-b057-d164af9c0cce tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:07.652232 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5305c7bf-72a3-4b6e-b057-d164af9c0cce tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:07.653085 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5305c7bf-72a3-4b6e-b057-d164af9c0cce tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:07.654131 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5305c7bf-72a3-4b6e-b057-d164af9c0cce tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:07.683860 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5305c7bf-72a3-4b6e-b057-d164af9c0cce tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044932 Jun 23 16:08:07.684691 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 379/761] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:08:07 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 16:08:07.748278 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-42129cd5-b762-4811-a319-58395678440f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lazy-loading 'services' on Instance uuid 8f780c86-8efc-4e87-be01-8cc68d03e036 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:08:07.758830 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0f71f1f1-a363-4120-898c-83305f67dd97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:07.759295 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0f71f1f1-a363-4120-898c-83305f67dd97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:07.765789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f71f1f1-a363-4120-898c-83305f67dd97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:07.766239 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f71f1f1-a363-4120-898c-83305f67dd97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:07.767024 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f71f1f1-a363-4120-898c-83305f67dd97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:07.767458 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0f71f1f1-a363-4120-898c-83305f67dd97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:07.771580 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:08:07.795055 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0f71f1f1-a363-4120-898c-83305f67dd97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:08:07.866305 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-42129cd5-b762-4811-a319-58395678440f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/os-volume_attachments/674d9e54-8e99-4e69-baac-bdfc410dd46a" status: 202 len: 0 microversion: 2.1 time: 0.264566 Jun 23 16:08:07.867038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 383/762] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 23 16:08:07 2022] DELETE /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/os-volume_attachments/674d9e54-8e99-4e69-baac-bdfc410dd46a => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 16:08:07.880332 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0f71f1f1-a363-4120-898c-83305f67dd97 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 204 len: 0 microversion: 2.1 time: 0.124916 Jun 23 16:08:07.881682 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 380/763] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:08:07 2022] DELETE /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:08:07.891358 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7e06f1e9-7cd3-4706-94af-bc576087999f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:07.892457 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7e06f1e9-7cd3-4706-94af-bc576087999f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:07.900113 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e06f1e9-7cd3-4706-94af-bc576087999f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:07.900540 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e06f1e9-7cd3-4706-94af-bc576087999f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:07.901390 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e06f1e9-7cd3-4706-94af-bc576087999f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:07.902128 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7e06f1e9-7cd3-4706-94af-bc576087999f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:08.032934 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7e06f1e9-7cd3-4706-94af-bc576087999f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:08.040506 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7e06f1e9-7cd3-4706-94af-bc576087999f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1688 microversion: 2.1 time: 0.154174 Jun 23 16:08:08.041087 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 384/764] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:07 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:08.413842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3396fe0c-58c7-4acf-9bd1-974b146b2f02 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:08.414541 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3396fe0c-58c7-4acf-9bd1-974b146b2f02 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:08.421252 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3396fe0c-58c7-4acf-9bd1-974b146b2f02 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:08.421701 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3396fe0c-58c7-4acf-9bd1-974b146b2f02 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:08.422459 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3396fe0c-58c7-4acf-9bd1-974b146b2f02 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:08.422934 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3396fe0c-58c7-4acf-9bd1-974b146b2f02 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:08.554651 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3396fe0c-58c7-4acf-9bd1-974b146b2f02 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:08.563184 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3396fe0c-58c7-4acf-9bd1-974b146b2f02 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.153459 Jun 23 16:08:08.563761 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 381/765] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:08 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:09.057614 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a78e3e20-cc48-4993-9aa2-2479b8fa62df tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:09.058217 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a78e3e20-cc48-4993-9aa2-2479b8fa62df tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:09.064832 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a78e3e20-cc48-4993-9aa2-2479b8fa62df tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:09.065270 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a78e3e20-cc48-4993-9aa2-2479b8fa62df tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:09.066021 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a78e3e20-cc48-4993-9aa2-2479b8fa62df tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:09.066444 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a78e3e20-cc48-4993-9aa2-2479b8fa62df tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:09.197775 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a78e3e20-cc48-4993-9aa2-2479b8fa62df tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:09.205748 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a78e3e20-cc48-4993-9aa2-2479b8fa62df tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1688 microversion: 2.1 time: 0.152501 Jun 23 16:08:09.206300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 385/766] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:09 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:09.524722 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-786ed670-1302-440c-81e4-715f407691ce req-d21190b5-fb7a-4303-a7d5-9fe41e71d4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d20925-62c2-42d3-9cd4-87cafcfcb78c", "name": "network-vif-plugged", "status": "completed", "tag": "a2b7418c-7a16-44c2-9376-785b79ce1926"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:09.535079 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-786ed670-1302-440c-81e4-715f407691ce req-d21190b5-fb7a-4303-a7d5-9fe41e71d4e3 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:09.535554 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-786ed670-1302-440c-81e4-715f407691ce req-d21190b5-fb7a-4303-a7d5-9fe41e71d4e3 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:09.547924 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-786ed670-1302-440c-81e4-715f407691ce req-d21190b5-fb7a-4303-a7d5-9fe41e71d4e3 service nova] Creating event network-vif-plugged:a2b7418c-7a16-44c2-9376-785b79ce1926 for instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c on hv-cinder-83538 Jun 23 16:08:09.554990 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-786ed670-1302-440c-81e4-715f407691ce req-d21190b5-fb7a-4303-a7d5-9fe41e71d4e3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032749 Jun 23 16:08:09.554990 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 382/767] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:08:09.581267 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-55aadb8f-4155-401a-960b-454d71190506 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:09.581885 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-55aadb8f-4155-401a-960b-454d71190506 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:09.588041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-55aadb8f-4155-401a-960b-454d71190506 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:09.594294 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-55aadb8f-4155-401a-960b-454d71190506 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:09.594445 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-55aadb8f-4155-401a-960b-454d71190506 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:09.594931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-55aadb8f-4155-401a-960b-454d71190506 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:09.738802 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-55aadb8f-4155-401a-960b-454d71190506 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:09.746378 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-55aadb8f-4155-401a-960b-454d71190506 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.169128 Jun 23 16:08:09.746922 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 386/768] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:09 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:10.223259 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ce186eb5-fe30-44d5-9788-604f7cbcbd9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:10.223960 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ce186eb5-fe30-44d5-9788-604f7cbcbd9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:10.230236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce186eb5-fe30-44d5-9788-604f7cbcbd9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:10.230678 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce186eb5-fe30-44d5-9788-604f7cbcbd9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:10.232166 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce186eb5-fe30-44d5-9788-604f7cbcbd9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:10.232605 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ce186eb5-fe30-44d5-9788-604f7cbcbd9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:10.362995 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ce186eb5-fe30-44d5-9788-604f7cbcbd9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:10.370463 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ce186eb5-fe30-44d5-9788-604f7cbcbd9a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1688 microversion: 2.1 time: 0.151407 Jun 23 16:08:10.371045 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 383/769] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:10 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:10.763237 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f93333e5-d7e8-4913-bfd4-36f4693ce4b5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:10.763847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f93333e5-d7e8-4913-bfd4-36f4693ce4b5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:10.770371 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f93333e5-d7e8-4913-bfd4-36f4693ce4b5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:10.770859 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f93333e5-d7e8-4913-bfd4-36f4693ce4b5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:10.771624 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f93333e5-d7e8-4913-bfd4-36f4693ce4b5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:10.772061 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f93333e5-d7e8-4913-bfd4-36f4693ce4b5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:10.907978 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f93333e5-d7e8-4913-bfd4-36f4693ce4b5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:10.915790 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f93333e5-d7e8-4913-bfd4-36f4693ce4b5 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.156368 Jun 23 16:08:10.916361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 387/770] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:10 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:11.387989 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-675012b7-09f7-4b8f-9328-34087541c2be tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:11.388597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-675012b7-09f7-4b8f-9328-34087541c2be tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:11.395169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-675012b7-09f7-4b8f-9328-34087541c2be tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:11.395610 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-675012b7-09f7-4b8f-9328-34087541c2be tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:11.396356 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-675012b7-09f7-4b8f-9328-34087541c2be tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:11.396775 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-675012b7-09f7-4b8f-9328-34087541c2be tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:11.541689 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-675012b7-09f7-4b8f-9328-34087541c2be tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:11.549633 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-675012b7-09f7-4b8f-9328-34087541c2be tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1688 microversion: 2.1 time: 0.165866 Jun 23 16:08:11.550207 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 384/771] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:11 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:11.932955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2e26287c-deb4-417d-8f24-664dc60eb4fd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:11.933591 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2e26287c-deb4-417d-8f24-664dc60eb4fd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:11.941500 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e26287c-deb4-417d-8f24-664dc60eb4fd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:11.942224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e26287c-deb4-417d-8f24-664dc60eb4fd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:11.943046 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e26287c-deb4-417d-8f24-664dc60eb4fd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:11.943484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2e26287c-deb4-417d-8f24-664dc60eb4fd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:12.079938 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2e26287c-deb4-417d-8f24-664dc60eb4fd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:12.089066 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2e26287c-deb4-417d-8f24-664dc60eb4fd tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.160258 Jun 23 16:08:12.089649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 388/772] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:11 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:12.566673 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-affd429e-542c-4fc1-a584-53af7dae0867 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:12.567407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-affd429e-542c-4fc1-a584-53af7dae0867 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:12.574614 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-affd429e-542c-4fc1-a584-53af7dae0867 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:12.575155 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-affd429e-542c-4fc1-a584-53af7dae0867 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:12.576196 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-affd429e-542c-4fc1-a584-53af7dae0867 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:12.576697 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-affd429e-542c-4fc1-a584-53af7dae0867 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:12.856383 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-affd429e-542c-4fc1-a584-53af7dae0867 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:12.865095 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-affd429e-542c-4fc1-a584-53af7dae0867 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1688 microversion: 2.1 time: 0.302099 Jun 23 16:08:12.875165 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 385/773] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:12 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1688 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:13.105431 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4d62746c-1f36-4785-bce3-8003821e280e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:13.106028 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4d62746c-1f36-4785-bce3-8003821e280e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:13.112878 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d62746c-1f36-4785-bce3-8003821e280e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:13.113415 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d62746c-1f36-4785-bce3-8003821e280e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:13.114285 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d62746c-1f36-4785-bce3-8003821e280e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:13.114825 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4d62746c-1f36-4785-bce3-8003821e280e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:13.211905 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-12d94c1f-ab11-47e7-8392-e65c9cb091be tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:13.219128 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-12d94c1f-ab11-47e7-8392-e65c9cb091be tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:13.219674 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-12d94c1f-ab11-47e7-8392-e65c9cb091be tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:13.258426 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4d62746c-1f36-4785-bce3-8003821e280e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:13.267054 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4d62746c-1f36-4785-bce3-8003821e280e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1574 microversion: 2.1 time: 0.165440 Jun 23 16:08:13.267847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 389/774] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:13 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:13.280971 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-12d94c1f-ab11-47e7-8392-e65c9cb091be tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Going to try to stop instance {{(pid=117891) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 16:08:13.329778 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-12d94c1f-ab11-47e7-8392-e65c9cb091be tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/action" status: 202 len: 0 microversion: 2.1 time: 0.121426 Jun 23 16:08:13.333931 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 386/775] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:08:13 2022] POST /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 16:08:13.335325 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-0bd99923-ae42-4fc9-ae3b-9448251f2b11 req-b6b22d98-3ccf-4f45-a310-5ab2c415ac58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "649b033e-63c2-44c2-a597-4192007bb977", "name": "network-vif-deleted", "tag": "c631e37e-f39c-4dd5-871a-90b0efe598ae"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:13.339412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c13e20fe-a22f-4311-b193-e066f56e2e2e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:13.340109 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c13e20fe-a22f-4311-b193-e066f56e2e2e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:13.343782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-0bd99923-ae42-4fc9-ae3b-9448251f2b11 req-b6b22d98-3ccf-4f45-a310-5ab2c415ac58 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:13.344226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-0bd99923-ae42-4fc9-ae3b-9448251f2b11 req-b6b22d98-3ccf-4f45-a310-5ab2c415ac58 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:13.346421 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c13e20fe-a22f-4311-b193-e066f56e2e2e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:13.346904 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c13e20fe-a22f-4311-b193-e066f56e2e2e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:13.347671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c13e20fe-a22f-4311-b193-e066f56e2e2e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:13.348103 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c13e20fe-a22f-4311-b193-e066f56e2e2e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:13.355374 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-0bd99923-ae42-4fc9-ae3b-9448251f2b11 req-b6b22d98-3ccf-4f45-a310-5ab2c415ac58 service nova] Creating event network-vif-deleted:c631e37e-f39c-4dd5-871a-90b0efe598ae for instance 649b033e-63c2-44c2-a597-4192007bb977 on hv-cinder-83538 Jun 23 16:08:13.362622 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-0bd99923-ae42-4fc9-ae3b-9448251f2b11 req-b6b22d98-3ccf-4f45-a310-5ab2c415ac58 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031019 Jun 23 16:08:13.363559 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 390/776] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:08:13.516410 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c13e20fe-a22f-4311-b193-e066f56e2e2e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:13.525511 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c13e20fe-a22f-4311-b193-e066f56e2e2e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.190005 Jun 23 16:08:13.526245 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 387/777] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:13 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:13.883010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:13.883743 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:13.890141 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:13.890592 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:13.891395 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:13.891831 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:13.895885 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:08:13.925065 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:13.925511 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:13.925968 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lazy-loading 'fault' on Instance uuid 649b033e-63c2-44c2-a597-4192007bb977 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:08:13.972829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:13.980472 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c1b522ec-c3af-4347-8bd0-dc3e37cce99b tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 200 len: 1334 microversion: 2.1 time: 0.101734 Jun 23 16:08:13.981077 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 391/778] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:13 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 1334 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:14.386783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-57dab2a3-f48f-44ca-9176-e1628e70f0a2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:14.388012 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-57dab2a3-f48f-44ca-9176-e1628e70f0a2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:14.397215 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-57dab2a3-f48f-44ca-9176-e1628e70f0a2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:14.397657 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-57dab2a3-f48f-44ca-9176-e1628e70f0a2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:14.398729 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-57dab2a3-f48f-44ca-9176-e1628e70f0a2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:14.399155 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-57dab2a3-f48f-44ca-9176-e1628e70f0a2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:14.533034 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-57dab2a3-f48f-44ca-9176-e1628e70f0a2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:14.540961 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-57dab2a3-f48f-44ca-9176-e1628e70f0a2 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1561 microversion: 2.1 time: 0.259739 Jun 23 16:08:14.541449 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 388/779] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:14 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1561 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:14.651013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d2bb6535-8ec1-4de6-bfd7-4e2672e2297a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:14.651618 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d2bb6535-8ec1-4de6-bfd7-4e2672e2297a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:14.658883 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d2bb6535-8ec1-4de6-bfd7-4e2672e2297a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:14.659564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d2bb6535-8ec1-4de6-bfd7-4e2672e2297a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:14.660447 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d2bb6535-8ec1-4de6-bfd7-4e2672e2297a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:14.661035 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d2bb6535-8ec1-4de6-bfd7-4e2672e2297a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:14.816903 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d2bb6535-8ec1-4de6-bfd7-4e2672e2297a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:14.824385 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d2bb6535-8ec1-4de6-bfd7-4e2672e2297a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.285349 Jun 23 16:08:14.825588 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 392/780] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:14 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:15.001389 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d0c6e1f3-d2ad-44e7-82fa-3e9e6e91406f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:15.001992 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d0c6e1f3-d2ad-44e7-82fa-3e9e6e91406f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 649b033e-63c2-44c2-a597-4192007bb977] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:15.008292 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0c6e1f3-d2ad-44e7-82fa-3e9e6e91406f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:15.008861 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0c6e1f3-d2ad-44e7-82fa-3e9e6e91406f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:15.009661 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0c6e1f3-d2ad-44e7-82fa-3e9e6e91406f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:15.010089 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d0c6e1f3-d2ad-44e7-82fa-3e9e6e91406f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:15.023731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-d0c6e1f3-d2ad-44e7-82fa-3e9e6e91406f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] HTTP exception thrown: Instance 649b033e-63c2-44c2-a597-4192007bb977 could not be found. Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d0c6e1f3-d2ad-44e7-82fa-3e9e6e91406f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Request method failure captured: Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 HTTP/1.1 Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4982N4I_q1MLhQUv7y__IsTVoVc_C4A24OIRUWCLxOkcQRrieSI2Pgytioaui_Pr0ZQoJFeqaHf1eDAR_1T3_jnmf7FblklhXX0H_LWu40tqQfHG6AN_wxK_-rLlHUEZPc4McdEJGI7Ye5KaaAaL_t5OM8F7CV92nevHTHOuzjgeg Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: f9eeca1030964294b8d813812abdcc5b Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:08:15.025482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f9eeca1030964294b8d813812abdcc5b"}]}] Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: f9eeca1030964294b8d813812abdcc5b Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-ServerRescueNegativeTestJSON-494893856-project Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: 228e5acf4578494ab1a28e4f530233f2 Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-ServerRescueNegativeTestJSON-494893856-project Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 649b033e-63c2-44c2-a597-4192007bb977 could not be found. Jun 23 16:08:15.027167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '649b033e-63c2-44c2-a597-4192007bb977'} Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 649b033e-63c2-44c2-a597-4192007bb977 could not be found. Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:08:15.028172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 649b033e-63c2-44c2-a597-4192007bb977 could not be found. Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 649b033e-63c2-44c2-a597-4192007bb977 could not be found. Jun 23 16:08:15.029709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:08:15.031180 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d0c6e1f3-d2ad-44e7-82fa-3e9e6e91406f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Returning 404 to user: Instance 649b033e-63c2-44c2-a597-4192007bb977 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:08:15.031180 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d0c6e1f3-d2ad-44e7-82fa-3e9e6e91406f tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977" status: 404 len: 111 microversion: 2.1 time: 0.030046 Jun 23 16:08:15.031180 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 389/781] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:14 2022] GET /compute/v2.1/servers/649b033e-63c2-44c2-a597-4192007bb977 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 16:08:15.035494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2d2622af-6711-45c8-9d5b-81913474d3bb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '.version_select at 0x7fe28d3e3f70>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:15.054504 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2d2622af-6711-45c8-9d5b-81913474d3bb tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470841333" status: 202 len: 0 microversion: 2.1 time: 0.022778 Jun 23 16:08:15.055119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 393/782] 10.222.0.46 () {58 vars in 1220 bytes} [Thu Jun 23 16:08:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1470841333 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 16:08:15.401360 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a06a511f-0770-4c81-9443-be480dd0a419 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:15.401910 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a06a511f-0770-4c81-9443-be480dd0a419 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:15.409215 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a06a511f-0770-4c81-9443-be480dd0a419 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:15.409731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a06a511f-0770-4c81-9443-be480dd0a419 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:15.410497 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a06a511f-0770-4c81-9443-be480dd0a419 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:15.410951 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a06a511f-0770-4c81-9443-be480dd0a419 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:15.437825 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a06a511f-0770-4c81-9443-be480dd0a419 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:08:15.518422 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a06a511f-0770-4c81-9443-be480dd0a419 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "DELETE /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 204 len: 0 microversion: 2.1 time: 0.121032 Jun 23 16:08:15.522374 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 390/783] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:08:15 2022] DELETE /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:08:15.531843 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a41e30a8-4390-4098-8855-cb08b2db8a32 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:15.531843 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a41e30a8-4390-4098-8855-cb08b2db8a32 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:15.535782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a41e30a8-4390-4098-8855-cb08b2db8a32 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:15.536238 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a41e30a8-4390-4098-8855-cb08b2db8a32 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:15.537014 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a41e30a8-4390-4098-8855-cb08b2db8a32 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:15.537453 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a41e30a8-4390-4098-8855-cb08b2db8a32 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:15.747096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a41e30a8-4390-4098-8855-cb08b2db8a32 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:15.754736 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a41e30a8-4390-4098-8855-cb08b2db8a32 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1578 microversion: 2.1 time: 0.230677 Jun 23 16:08:15.755391 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 394/784] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:15 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1578 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:08:15.842489 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-31b456f2-38df-4f28-8bbb-beca27824b41 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:15.843221 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-31b456f2-38df-4f28-8bbb-beca27824b41 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:15.849170 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31b456f2-38df-4f28-8bbb-beca27824b41 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:15.849620 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31b456f2-38df-4f28-8bbb-beca27824b41 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:15.850376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31b456f2-38df-4f28-8bbb-beca27824b41 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:15.850845 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-31b456f2-38df-4f28-8bbb-beca27824b41 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:15.978903 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-31b456f2-38df-4f28-8bbb-beca27824b41 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:15.986442 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-31b456f2-38df-4f28-8bbb-beca27824b41 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.148840 Jun 23 16:08:15.987035 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 391/785] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:15 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:16.773157 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a702da93-f43e-4ea9-8b54-fa2215985d2c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:16.773742 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a702da93-f43e-4ea9-8b54-fa2215985d2c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:16.780749 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a702da93-f43e-4ea9-8b54-fa2215985d2c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:16.781189 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a702da93-f43e-4ea9-8b54-fa2215985d2c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:16.781935 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a702da93-f43e-4ea9-8b54-fa2215985d2c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:16.782362 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a702da93-f43e-4ea9-8b54-fa2215985d2c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:16.915631 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a702da93-f43e-4ea9-8b54-fa2215985d2c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:16.923921 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a702da93-f43e-4ea9-8b54-fa2215985d2c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1578 microversion: 2.1 time: 0.154889 Jun 23 16:08:16.924494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 395/786] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:16 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:17.004474 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b41715a4-c448-48db-b4b9-145b0d6f206f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:17.005121 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b41715a4-c448-48db-b4b9-145b0d6f206f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:17.011727 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b41715a4-c448-48db-b4b9-145b0d6f206f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:17.012174 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b41715a4-c448-48db-b4b9-145b0d6f206f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:17.012970 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b41715a4-c448-48db-b4b9-145b0d6f206f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:17.013405 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b41715a4-c448-48db-b4b9-145b0d6f206f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:17.154662 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b41715a4-c448-48db-b4b9-145b0d6f206f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:17.163015 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b41715a4-c448-48db-b4b9-145b0d6f206f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.162358 Jun 23 16:08:17.163684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 392/787] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:16 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:17.942020 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-126a65db-e107-46c5-8fb6-844e96a64d16 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:17.942663 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-126a65db-e107-46c5-8fb6-844e96a64d16 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:17.949688 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-126a65db-e107-46c5-8fb6-844e96a64d16 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:17.950173 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-126a65db-e107-46c5-8fb6-844e96a64d16 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:17.951004 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-126a65db-e107-46c5-8fb6-844e96a64d16 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:17.951445 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-126a65db-e107-46c5-8fb6-844e96a64d16 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:17.986834 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6a61b80e-9083-48ec-80f6-73e26cebcd90 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:17.987334 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6a61b80e-9083-48ec-80f6-73e26cebcd90 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:17.994266 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6a61b80e-9083-48ec-80f6-73e26cebcd90 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:17.994436 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6a61b80e-9083-48ec-80f6-73e26cebcd90 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:17.995226 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6a61b80e-9083-48ec-80f6-73e26cebcd90 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:17.996633 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6a61b80e-9083-48ec-80f6-73e26cebcd90 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:18.023103 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6a61b80e-9083-48ec-80f6-73e26cebcd90 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:08:18.028638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:08:18.113238 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6a61b80e-9083-48ec-80f6-73e26cebcd90 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 204 len: 0 microversion: 2.1 time: 0.129499 Jun 23 16:08:18.117395 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 393/788] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:08:17 2022] DELETE /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:08:18.126969 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-568da9e1-4f40-41b9-8813-457f0b4bf92a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:18.128220 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-568da9e1-4f40-41b9-8813-457f0b4bf92a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:18.129200 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-126a65db-e107-46c5-8fb6-844e96a64d16 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:18.136570 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-568da9e1-4f40-41b9-8813-457f0b4bf92a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:18.138082 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-568da9e1-4f40-41b9-8813-457f0b4bf92a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:18.139053 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-568da9e1-4f40-41b9-8813-457f0b4bf92a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:18.139559 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-126a65db-e107-46c5-8fb6-844e96a64d16 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1578 microversion: 2.1 time: 0.201596 Jun 23 16:08:18.140040 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-568da9e1-4f40-41b9-8813-457f0b4bf92a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:18.140592 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 396/789] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:17 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1578 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:18.181170 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5eb37b02-444f-46a9-9a50-99ff43858d64 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:18.181776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5eb37b02-444f-46a9-9a50-99ff43858d64 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:18.188158 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5eb37b02-444f-46a9-9a50-99ff43858d64 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:18.188582 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5eb37b02-444f-46a9-9a50-99ff43858d64 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:18.189368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5eb37b02-444f-46a9-9a50-99ff43858d64 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:18.189794 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5eb37b02-444f-46a9-9a50-99ff43858d64 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:18.318654 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-5eb37b02-444f-46a9-9a50-99ff43858d64 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:18.327257 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5eb37b02-444f-46a9-9a50-99ff43858d64 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.149890 Jun 23 16:08:18.327834 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 397/790] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:18 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:08:18.357215 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-568da9e1-4f40-41b9-8813-457f0b4bf92a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:18.364691 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-568da9e1-4f40-41b9-8813-457f0b4bf92a tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1507 microversion: 2.1 time: 0.245661 Jun 23 16:08:18.365268 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 394/791] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:18 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:18.465015 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-ba3001e9-9bc1-4390-8b52-54a1a525bd24 req-bbf417c8-685d-420a-af74-ef5850959a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1", "name": "network-vif-deleted", "tag": "ee05b6a8-bcfd-4af9-baec-36320570c58e"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:18.473344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:08:18.475576 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-ba3001e9-9bc1-4390-8b52-54a1a525bd24 req-bbf417c8-685d-420a-af74-ef5850959a2b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:18.476022 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-ba3001e9-9bc1-4390-8b52-54a1a525bd24 req-bbf417c8-685d-420a-af74-ef5850959a2b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:18.488719 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-ba3001e9-9bc1-4390-8b52-54a1a525bd24 req-bbf417c8-685d-420a-af74-ef5850959a2b service nova] Creating event network-vif-deleted:ee05b6a8-bcfd-4af9-baec-36320570c58e for instance af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 on hv-cinder-83538 Jun 23 16:08:18.494068 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-ba3001e9-9bc1-4390-8b52-54a1a525bd24 req-bbf417c8-685d-420a-af74-ef5850959a2b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032695 Jun 23 16:08:18.495272 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 398/792] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:08:19.157370 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:19.157936 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:19.160385 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:08:19.166185 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:19.166627 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:19.167429 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:19.167854 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:19.209693 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:19.210148 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:19.210603 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lazy-loading 'fault' on Instance uuid af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:08:19.267017 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:19.274723 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4f8ebdc7-c964-43ee-902b-a50c06180e78 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 200 len: 1231 microversion: 2.1 time: 0.121546 Jun 23 16:08:19.279092 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 395/793] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:19 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 1231 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:19.344876 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-44959a73-2e48-40bb-9506-908a1bb7a260 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:19.345689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-44959a73-2e48-40bb-9506-908a1bb7a260 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:19.355875 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44959a73-2e48-40bb-9506-908a1bb7a260 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:19.356619 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44959a73-2e48-40bb-9506-908a1bb7a260 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:19.357468 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44959a73-2e48-40bb-9506-908a1bb7a260 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:19.362882 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-44959a73-2e48-40bb-9506-908a1bb7a260 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:19.390457 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-805ba401-e3e7-4879-be3b-661ee40a8681 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:19.392503 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-805ba401-e3e7-4879-be3b-661ee40a8681 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:19.410168 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-805ba401-e3e7-4879-be3b-661ee40a8681 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:19.411164 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-805ba401-e3e7-4879-be3b-661ee40a8681 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:19.412746 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-805ba401-e3e7-4879-be3b-661ee40a8681 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:19.415257 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-805ba401-e3e7-4879-be3b-661ee40a8681 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:19.543522 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-44959a73-2e48-40bb-9506-908a1bb7a260 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:19.552591 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-44959a73-2e48-40bb-9506-908a1bb7a260 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.212549 Jun 23 16:08:19.562252 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 399/794] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:19 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:19.638767 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-805ba401-e3e7-4879-be3b-661ee40a8681 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:19.646899 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-805ba401-e3e7-4879-be3b-661ee40a8681 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 200 len: 1507 microversion: 2.1 time: 0.268167 Jun 23 16:08:19.647671 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 396/795] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:19 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:20.292892 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-26b0a885-4c74-4a86-8a85-d4a49d363a8c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:20.293509 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-26b0a885-4c74-4a86-8a85-d4a49d363a8c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:20.300131 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-26b0a885-4c74-4a86-8a85-d4a49d363a8c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.300592 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-26b0a885-4c74-4a86-8a85-d4a49d363a8c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.301354 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-26b0a885-4c74-4a86-8a85-d4a49d363a8c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.301797 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-26b0a885-4c74-4a86-8a85-d4a49d363a8c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.317336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-26b0a885-4c74-4a86-8a85-d4a49d363a8c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] HTTP exception thrown: Instance af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 could not be found. Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-26b0a885-4c74-4a86-8a85-d4a49d363a8c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Request method failure captured: Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 HTTP/1.1 Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI8RtbUqRTFK2A_MYC5Pxmumr6mgPeKTv2XBbcsGLzZCv1fq-KgjAjZmQEufMfBZhM2Z7GeJc7NtyUHiz9JgBmxTgNigY3fsuNe4DTHfTHGB80ZR8-uJVKt70mFzLUBDuc9Rig_h3HLJ1PsVUiYp4WZonhssiQRCweAZCsCfOX603xg Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 42ebe5dc582e4a6b92d4f18002a0ffba Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-TestVolumeBootPattern-389253357 Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:08:20.319096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42ebe5dc582e4a6b92d4f18002a0ffba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/42ebe5dc582e4a6b92d4f18002a0ffba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/42ebe5dc582e4a6b92d4f18002a0ffba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_42ebe5dc582e4a6b92d4f18002a0ffba"}]}] Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-TestVolumeBootPattern-389253357 Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 42ebe5dc582e4a6b92d4f18002a0ffba Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-TestVolumeBootPattern-389253357 Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-TestVolumeBootPattern-389253357-project Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: c953617a01f1401c966c16467138d628 Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-TestVolumeBootPattern-389253357-project Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 could not be found. Jun 23 16:08:20.320639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': 'af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1'} Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 could not be found. Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:08:20.321418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 could not be found. Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 could not be found. Jun 23 16:08:20.322798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:20.324028 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-26b0a885-4c74-4a86-8a85-d4a49d363a8c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Returning 404 to user: Instance af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:08:20.324028 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-26b0a885-4c74-4a86-8a85-d4a49d363a8c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1" status: 404 len: 111 microversion: 2.1 time: 0.031575 Jun 23 16:08:20.324028 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 400/796] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:20 2022] GET /compute/v2.1/servers/af8861a7-5a57-4bf1-8eb1-0e28ee2e1dd1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:08:20.368497 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1258318498", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1983304844", "security_groups": [{"name": "tempest-secgroup-smoke-1309684319"}], "block_device_mapping_v2": [{"uuid": "111b1162-f970-4a28-9c9d-2832578f0391", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebbee555-602b-4494-b3d4-95250f3b8a84"}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:20.480311 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] validate_networks() for [('ebbee555-602b-4494-b3d4-95250f3b8a84', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:08:20.515730 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-34a63326-a41d-4de0-875f-782baa42a014 req-89525267-c4bf-4fc1-b4b2-f1dae0836bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "777072f3-db6b-4c68-8fbb-e300170a00b8", "name": "network-vif-deleted", "tag": "5a29fed5-a9ab-4a4e-801f-a191224a8a53"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:20.524470 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-34a63326-a41d-4de0-875f-782baa42a014 req-89525267-c4bf-4fc1-b4b2-f1dae0836bcc service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.524914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-34a63326-a41d-4de0-875f-782baa42a014 req-89525267-c4bf-4fc1-b4b2-f1dae0836bcc service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.539149 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-34a63326-a41d-4de0-875f-782baa42a014 req-89525267-c4bf-4fc1-b4b2-f1dae0836bcc service nova] Creating event network-vif-deleted:5a29fed5-a9ab-4a4e-801f-a191224a8a53 for instance 777072f3-db6b-4c68-8fbb-e300170a00b8 on hv-cinder-83538 Jun 23 16:08:20.545261 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-34a63326-a41d-4de0-875f-782baa42a014 req-89525267-c4bf-4fc1-b4b2-f1dae0836bcc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032239 Jun 23 16:08:20.545851 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 401/797] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:08:20.574523 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c6497aaa-6be6-45c3-aab9-dd2f0fcdc1ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:20.574523 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c6497aaa-6be6-45c3-aab9-dd2f0fcdc1ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:20.578703 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6497aaa-6be6-45c3-aab9-dd2f0fcdc1ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.579149 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6497aaa-6be6-45c3-aab9-dd2f0fcdc1ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.580009 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6497aaa-6be6-45c3-aab9-dd2f0fcdc1ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.580438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c6497aaa-6be6-45c3-aab9-dd2f0fcdc1ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.713302 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c6497aaa-6be6-45c3-aab9-dd2f0fcdc1ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:20.721433 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c6497aaa-6be6-45c3-aab9-dd2f0fcdc1ac tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.154500 Jun 23 16:08:20.722002 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 402/798] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:20 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:08:20.726379 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e7ee79d5-e5d0-4fdd-aabe-89ac6a74b513 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:20.726998 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e7ee79d5-e5d0-4fdd-aabe-89ac6a74b513 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 777072f3-db6b-4c68-8fbb-e300170a00b8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:20.733465 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e7ee79d5-e5d0-4fdd-aabe-89ac6a74b513 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.733908 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e7ee79d5-e5d0-4fdd-aabe-89ac6a74b513 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.734664 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e7ee79d5-e5d0-4fdd-aabe-89ac6a74b513 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.735117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e7ee79d5-e5d0-4fdd-aabe-89ac6a74b513 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.748487 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-e7ee79d5-e5d0-4fdd-aabe-89ac6a74b513 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] HTTP exception thrown: Instance 777072f3-db6b-4c68-8fbb-e300170a00b8 could not be found. Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e7ee79d5-e5d0-4fdd-aabe-89ac6a74b513 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Request method failure captured: Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 HTTP/1.1 Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4982N4I_q1MLhQUv7y__IsTVoVc_C4A24OIRUWCLxOkcQRrieSI2Pgytioaui_Pr0ZQoJFeqaHf1eDAR_1T3_jnmf7FblklhXX0H_LWu40tqQfHG6AN_wxK_-rLlHUEZPc4McdEJGI7Ye5KaaAaL_t5OM8F7CV92nevHTHOuzjgeg Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: f9eeca1030964294b8d813812abdcc5b Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:08:20.750103 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f9eeca1030964294b8d813812abdcc5b"}]}] Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: f9eeca1030964294b8d813812abdcc5b Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-ServerRescueNegativeTestJSON-494893856-project Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: 228e5acf4578494ab1a28e4f530233f2 Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-ServerRescueNegativeTestJSON-494893856-project Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 777072f3-db6b-4c68-8fbb-e300170a00b8 could not be found. Jun 23 16:08:20.751658 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '777072f3-db6b-4c68-8fbb-e300170a00b8'} Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 777072f3-db6b-4c68-8fbb-e300170a00b8 could not be found. Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:08:20.752534 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 777072f3-db6b-4c68-8fbb-e300170a00b8 could not be found. Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 777072f3-db6b-4c68-8fbb-e300170a00b8 could not be found. Jun 23 16:08:20.753684 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:20.754773 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e7ee79d5-e5d0-4fdd-aabe-89ac6a74b513 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Returning 404 to user: Instance 777072f3-db6b-4c68-8fbb-e300170a00b8 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:08:20.754773 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e7ee79d5-e5d0-4fdd-aabe-89ac6a74b513 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8" status: 404 len: 111 microversion: 2.1 time: 0.028608 Jun 23 16:08:20.754773 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 403/799] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:20 2022] GET /compute/v2.1/servers/777072f3-db6b-4c68-8fbb-e300170a00b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:08:20.759617 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9ae68fba-6745-4535-9969-efdebe9735ae tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:20.760101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9ae68fba-6745-4535-9969-efdebe9735ae tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:20.765897 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ae68fba-6745-4535-9969-efdebe9735ae tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.766341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ae68fba-6745-4535-9969-efdebe9735ae tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.767131 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ae68fba-6745-4535-9969-efdebe9735ae tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.767537 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9ae68fba-6745-4535-9969-efdebe9735ae tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.793134 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9ae68fba-6745-4535-9969-efdebe9735ae tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:08:20.872445 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9ae68fba-6745-4535-9969-efdebe9735ae tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "DELETE /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 204 len: 0 microversion: 2.1 time: 0.115839 Jun 23 16:08:20.873416 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 404/800] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:08:20 2022] DELETE /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:08:20.882959 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b49a1b11-a67c-4089-a253-96edbf1f49b9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:20.883608 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:08:20.883725 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b49a1b11-a67c-4089-a253-96edbf1f49b9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:20.884155 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:08:20.884728 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:08:20.885226 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:08:20.885686 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:08:20.889578 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b49a1b11-a67c-4089-a253-96edbf1f49b9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.890033 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b49a1b11-a67c-4089-a253-96edbf1f49b9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.890796 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b49a1b11-a67c-4089-a253-96edbf1f49b9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.891224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b49a1b11-a67c-4089-a253-96edbf1f49b9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.895027 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.895553 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.896468 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:20.896909 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:20.915555 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Getting quotas for project 42ebe5dc582e4a6b92d4f18002a0ffba. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:08:20.920111 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Getting quotas for user c953617a01f1401c966c16467138d628 and project 42ebe5dc582e4a6b92d4f18002a0ffba. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:08:20.979347 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:08:20.981477 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='111b1162-f970-4a28-9c9d-2832578f0391',volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:08:21.038814 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b49a1b11-a67c-4089-a253-96edbf1f49b9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:21.048514 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b49a1b11-a67c-4089-a253-96edbf1f49b9 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.170999 Jun 23 16:08:21.049417 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 405/801] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:20 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:21.125527 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-201d941d-6a11-4d7b-b3fe-053a861e455d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760713 Jun 23 16:08:21.131207 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 397/802] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:08:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:08:21.136946 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8947695b-7b89-45be-b549-bd0d070cfd81 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:21.138418 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8947695b-7b89-45be-b549-bd0d070cfd81 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:21.193356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8947695b-7b89-45be-b549-bd0d070cfd81 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:21.200867 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8947695b-7b89-45be-b549-bd0d070cfd81 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1095 microversion: 2.1 time: 0.067211 Jun 23 16:08:21.201514 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 406/803] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:21 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:21.740259 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8ddf12a1-d1da-4f07-ae22-88fc973907f5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:21.740847 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8ddf12a1-d1da-4f07-ae22-88fc973907f5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:21.747502 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8ddf12a1-d1da-4f07-ae22-88fc973907f5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:21.747951 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8ddf12a1-d1da-4f07-ae22-88fc973907f5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:21.748713 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8ddf12a1-d1da-4f07-ae22-88fc973907f5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:21.749150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8ddf12a1-d1da-4f07-ae22-88fc973907f5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:21.875990 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8ddf12a1-d1da-4f07-ae22-88fc973907f5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:21.883357 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8ddf12a1-d1da-4f07-ae22-88fc973907f5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.147565 Jun 23 16:08:21.883904 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 398/804] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:21 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:22.066251 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0d7e74b8-57f4-4b09-94db-e11d0e6cb519 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:22.066824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0d7e74b8-57f4-4b09-94db-e11d0e6cb519 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:22.074387 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0d7e74b8-57f4-4b09-94db-e11d0e6cb519 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:22.074871 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0d7e74b8-57f4-4b09-94db-e11d0e6cb519 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:22.076292 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0d7e74b8-57f4-4b09-94db-e11d0e6cb519 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:22.076742 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0d7e74b8-57f4-4b09-94db-e11d0e6cb519 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:22.213762 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0d7e74b8-57f4-4b09-94db-e11d0e6cb519 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:22.218984 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-af168726-215c-45c7-884a-b4e454845f88 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:22.219605 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-af168726-215c-45c7-884a-b4e454845f88 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:22.222139 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0d7e74b8-57f4-4b09-94db-e11d0e6cb519 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.159766 Jun 23 16:08:22.222927 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 407/805] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:22 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:22.225867 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af168726-215c-45c7-884a-b4e454845f88 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:22.226380 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af168726-215c-45c7-884a-b4e454845f88 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:22.227236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af168726-215c-45c7-884a-b4e454845f88 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:22.227738 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af168726-215c-45c7-884a-b4e454845f88 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:22.294715 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-af168726-215c-45c7-884a-b4e454845f88 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:22.303102 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-af168726-215c-45c7-884a-b4e454845f88 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1137 microversion: 2.1 time: 0.088593 Jun 23 16:08:22.303692 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 399/806] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:22 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1137 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:08:22.901464 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a4489d47-a9ac-4df3-89bf-af63c18209af tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:22.902524 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a4489d47-a9ac-4df3-89bf-af63c18209af tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:22.909758 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a4489d47-a9ac-4df3-89bf-af63c18209af tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:22.910748 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a4489d47-a9ac-4df3-89bf-af63c18209af tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:22.911914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a4489d47-a9ac-4df3-89bf-af63c18209af tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:22.912499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a4489d47-a9ac-4df3-89bf-af63c18209af tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:23.159985 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a4489d47-a9ac-4df3-89bf-af63c18209af tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:23.167974 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a4489d47-a9ac-4df3-89bf-af63c18209af tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.271062 Jun 23 16:08:23.169368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 408/807] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:22 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:23.239997 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0ca37222-83ca-4a17-abdc-6222d62269b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:23.241284 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0ca37222-83ca-4a17-abdc-6222d62269b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:23.248331 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0ca37222-83ca-4a17-abdc-6222d62269b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:23.248772 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0ca37222-83ca-4a17-abdc-6222d62269b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:23.249540 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0ca37222-83ca-4a17-abdc-6222d62269b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:23.249958 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0ca37222-83ca-4a17-abdc-6222d62269b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:23.321780 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2f52a993-4070-4f27-a77e-cbc67054c14b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:23.322430 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2f52a993-4070-4f27-a77e-cbc67054c14b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:23.331154 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f52a993-4070-4f27-a77e-cbc67054c14b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:23.331710 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f52a993-4070-4f27-a77e-cbc67054c14b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:23.333399 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f52a993-4070-4f27-a77e-cbc67054c14b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:23.334052 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2f52a993-4070-4f27-a77e-cbc67054c14b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:23.608308 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2f52a993-4070-4f27-a77e-cbc67054c14b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:23.625552 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2f52a993-4070-4f27-a77e-cbc67054c14b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1211 microversion: 2.1 time: 0.307762 Jun 23 16:08:23.626161 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 409/808] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:23 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1211 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:08:23.631240 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-af67d13a-246e-4a44-a775-f7352891ccc4 req-2de437bd-6be7-4269-8a8b-db5eea428b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "030dcf0e-dfb9-4e58-a617-f6330ae03134", "name": "network-vif-deleted", "tag": "492927a9-54a0-4835-8cdd-c1cd95b4eac3"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:23.640409 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-af67d13a-246e-4a44-a775-f7352891ccc4 req-2de437bd-6be7-4269-8a8b-db5eea428b2f service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:23.640921 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-af67d13a-246e-4a44-a775-f7352891ccc4 req-2de437bd-6be7-4269-8a8b-db5eea428b2f service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:23.652414 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-af67d13a-246e-4a44-a775-f7352891ccc4 req-2de437bd-6be7-4269-8a8b-db5eea428b2f service nova] Creating event network-vif-deleted:492927a9-54a0-4835-8cdd-c1cd95b4eac3 for instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 on hv-cinder-83538 Jun 23 16:08:23.657567 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-af67d13a-246e-4a44-a775-f7352891ccc4 req-2de437bd-6be7-4269-8a8b-db5eea428b2f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030106 Jun 23 16:08:23.658463 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 410/809] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:08:23.774988 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0ca37222-83ca-4a17-abdc-6222d62269b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '228e5acf4578494ab1a28e4f530233f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9eeca1030964294b8d813812abdcc5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:23.783544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0ca37222-83ca-4a17-abdc-6222d62269b3 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 200 len: 1522 microversion: 2.1 time: 0.548011 Jun 23 16:08:23.784222 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 400/810] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:23 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:24.190494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-16e15bf2-7d45-42c7-9f8b-bab82b05f569 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:24.193221 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-16e15bf2-7d45-42c7-9f8b-bab82b05f569 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:24.201056 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-16e15bf2-7d45-42c7-9f8b-bab82b05f569 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:24.201981 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-16e15bf2-7d45-42c7-9f8b-bab82b05f569 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:24.203381 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-16e15bf2-7d45-42c7-9f8b-bab82b05f569 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:24.204848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-16e15bf2-7d45-42c7-9f8b-bab82b05f569 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:24.211619 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:08:24.354485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-16e15bf2-7d45-42c7-9f8b-bab82b05f569 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:24.362119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-16e15bf2-7d45-42c7-9f8b-bab82b05f569 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.179791 Jun 23 16:08:24.362682 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 411/811] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:24 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:24.643886 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3e4d8eb3-b28f-4996-972b-03cbdd0e8f4d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:24.645105 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3e4d8eb3-b28f-4996-972b-03cbdd0e8f4d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:24.653658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3e4d8eb3-b28f-4996-972b-03cbdd0e8f4d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:24.654111 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3e4d8eb3-b28f-4996-972b-03cbdd0e8f4d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:24.654966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3e4d8eb3-b28f-4996-972b-03cbdd0e8f4d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:24.655401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3e4d8eb3-b28f-4996-972b-03cbdd0e8f4d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:24.781414 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-b98c6aa0-6d23-4120-85b4-b8b27b5fa1ec req-7da524be-5ba7-435f-98b8-769e857590c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebbd10bd-a125-4d68-addf-5409260490d4", "tag": "81683d16-0178-4e80-8f3d-602273915cfa"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:24.794032 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-b98c6aa0-6d23-4120-85b4-b8b27b5fa1ec req-7da524be-5ba7-435f-98b8-769e857590c6 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:24.794607 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-b98c6aa0-6d23-4120-85b4-b8b27b5fa1ec req-7da524be-5ba7-435f-98b8-769e857590c6 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:24.808845 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-b98c6aa0-6d23-4120-85b4-b8b27b5fa1ec req-7da524be-5ba7-435f-98b8-769e857590c6 service nova] Creating event network-changed:81683d16-0178-4e80-8f3d-602273915cfa for instance ebbd10bd-a125-4d68-addf-5409260490d4 on hv-cinder-83538 Jun 23 16:08:24.815587 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-b98c6aa0-6d23-4120-85b4-b8b27b5fa1ec req-7da524be-5ba7-435f-98b8-769e857590c6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038194 Jun 23 16:08:24.816676 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 412/812] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:08:24.823632 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-815ac885-75e2-4e37-b231-221d027c5f10 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:24.824579 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-815ac885-75e2-4e37-b231-221d027c5f10 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] [instance: 030dcf0e-dfb9-4e58-a617-f6330ae03134] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:24.832606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-815ac885-75e2-4e37-b231-221d027c5f10 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:24.833443 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-815ac885-75e2-4e37-b231-221d027c5f10 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:24.834488 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-815ac885-75e2-4e37-b231-221d027c5f10 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:24.835222 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-815ac885-75e2-4e37-b231-221d027c5f10 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:24.853449 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-815ac885-75e2-4e37-b231-221d027c5f10 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] HTTP exception thrown: Instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 could not be found. Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-815ac885-75e2-4e37-b231-221d027c5f10 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Request method failure captured: Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 HTTP/1.1 Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4982N4I_q1MLhQUv7y__IsTVoVc_C4A24OIRUWCLxOkcQRrieSI2Pgytioaui_Pr0ZQoJFeqaHf1eDAR_1T3_jnmf7FblklhXX0H_LWu40tqQfHG6AN_wxK_-rLlHUEZPc4McdEJGI7Ye5KaaAaL_t5OM8F7CV92nevHTHOuzjgeg Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: f9eeca1030964294b8d813812abdcc5b Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:08:24.855197 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/f9eeca1030964294b8d813812abdcc5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_f9eeca1030964294b8d813812abdcc5b"}]}] Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: f9eeca1030964294b8d813812abdcc5b Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-494893856 Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-ServerRescueNegativeTestJSON-494893856-project Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: 228e5acf4578494ab1a28e4f530233f2 Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-ServerRescueNegativeTestJSON-494893856-project Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 could not be found. Jun 23 16:08:24.857368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '030dcf0e-dfb9-4e58-a617-f6330ae03134'} Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 could not be found. Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:08:24.858236 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 could not be found. Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 could not be found. Jun 23 16:08:24.859782 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:24.861114 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-815ac885-75e2-4e37-b231-221d027c5f10 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] Returning 404 to user: Instance 030dcf0e-dfb9-4e58-a617-f6330ae03134 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:08:24.861711 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-815ac885-75e2-4e37-b231-221d027c5f10 tempest-ServerRescueNegativeTestJSON-494893856 tempest-ServerRescueNegativeTestJSON-494893856-project] 10.222.0.46 "GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134" status: 404 len: 111 microversion: 2.1 time: 0.043568 Jun 23 16:08:24.866264 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 413/813] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:24 2022] GET /compute/v2.1/servers/030dcf0e-dfb9-4e58-a617-f6330ae03134 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:08:24.892099 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3e4d8eb3-b28f-4996-972b-03cbdd0e8f4d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:24.904390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3e4d8eb3-b28f-4996-972b-03cbdd0e8f4d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.265429 Jun 23 16:08:24.905544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 401/814] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:24 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:25.379035 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-e088b02f-9c9c-46f9-9174-124ca023224a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:25.379676 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-e088b02f-9c9c-46f9-9174-124ca023224a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:25.386300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e088b02f-9c9c-46f9-9174-124ca023224a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:25.386955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e088b02f-9c9c-46f9-9174-124ca023224a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:25.388426 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e088b02f-9c9c-46f9-9174-124ca023224a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:25.388875 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-e088b02f-9c9c-46f9-9174-124ca023224a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:25.597725 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-e088b02f-9c9c-46f9-9174-124ca023224a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:25.605355 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-e088b02f-9c9c-46f9-9174-124ca023224a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.230171 Jun 23 16:08:25.605923 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 414/815] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:25 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:25.921953 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f18d5cde-61b7-4c4a-9544-68a4b497dca4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:25.922777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f18d5cde-61b7-4c4a-9544-68a4b497dca4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:25.929845 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f18d5cde-61b7-4c4a-9544-68a4b497dca4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:25.930298 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f18d5cde-61b7-4c4a-9544-68a4b497dca4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:25.931101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f18d5cde-61b7-4c4a-9544-68a4b497dca4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:25.931539 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f18d5cde-61b7-4c4a-9544-68a4b497dca4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:26.086085 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f18d5cde-61b7-4c4a-9544-68a4b497dca4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:26.095958 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f18d5cde-61b7-4c4a-9544-68a4b497dca4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.178396 Jun 23 16:08:26.096536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 402/816] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:25 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:26.624372 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-82d95713-60ad-4c99-8506-cc5b22c06f4c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:26.642724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-82d95713-60ad-4c99-8506-cc5b22c06f4c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:26.642724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82d95713-60ad-4c99-8506-cc5b22c06f4c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:26.642724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82d95713-60ad-4c99-8506-cc5b22c06f4c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:26.642724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82d95713-60ad-4c99-8506-cc5b22c06f4c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:26.643316 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-82d95713-60ad-4c99-8506-cc5b22c06f4c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:27.112747 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-396190c1-fdff-41bb-941f-3743cadc23f6 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:27.113362 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-396190c1-fdff-41bb-941f-3743cadc23f6 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:27.119926 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-396190c1-fdff-41bb-941f-3743cadc23f6 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:27.120373 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-396190c1-fdff-41bb-941f-3743cadc23f6 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:27.121142 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-396190c1-fdff-41bb-941f-3743cadc23f6 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:27.121595 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-396190c1-fdff-41bb-941f-3743cadc23f6 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:27.128919 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-82d95713-60ad-4c99-8506-cc5b22c06f4c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:27.136934 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-82d95713-60ad-4c99-8506-cc5b22c06f4c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.517349 Jun 23 16:08:27.138233 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 415/817] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:26 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:27.277150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-396190c1-fdff-41bb-941f-3743cadc23f6 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:27.287289 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-396190c1-fdff-41bb-941f-3743cadc23f6 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.178327 Jun 23 16:08:27.287871 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 403/818] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:27 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:28.156181 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-381437ca-ea92-413e-8075-437e1743d655 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:28.156962 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-381437ca-ea92-413e-8075-437e1743d655 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:28.164582 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-381437ca-ea92-413e-8075-437e1743d655 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:28.165159 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-381437ca-ea92-413e-8075-437e1743d655 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:28.166066 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-381437ca-ea92-413e-8075-437e1743d655 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:28.166615 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-381437ca-ea92-413e-8075-437e1743d655 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:28.304273 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c879102d-a331-453d-aa22-a704eb2486a3 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:28.304885 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c879102d-a331-453d-aa22-a704eb2486a3 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:28.311557 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c879102d-a331-453d-aa22-a704eb2486a3 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:28.312009 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c879102d-a331-453d-aa22-a704eb2486a3 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:28.312835 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c879102d-a331-453d-aa22-a704eb2486a3 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:28.313199 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c879102d-a331-453d-aa22-a704eb2486a3 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:28.424644 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-381437ca-ea92-413e-8075-437e1743d655 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:28.432995 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-381437ca-ea92-413e-8075-437e1743d655 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1678 microversion: 2.1 time: 0.282050 Jun 23 16:08:28.435776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 416/819] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:28 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1678 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:28.466821 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c879102d-a331-453d-aa22-a704eb2486a3 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:28.480537 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c879102d-a331-453d-aa22-a704eb2486a3 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.180105 Jun 23 16:08:28.481134 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 404/820] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:28 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:08:29.451948 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b39c98b9-7fd3-4b8b-8708-103d6f9e63c9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:29.452562 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b39c98b9-7fd3-4b8b-8708-103d6f9e63c9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:29.459407 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b39c98b9-7fd3-4b8b-8708-103d6f9e63c9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:29.459915 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b39c98b9-7fd3-4b8b-8708-103d6f9e63c9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:29.460693 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b39c98b9-7fd3-4b8b-8708-103d6f9e63c9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:29.461142 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b39c98b9-7fd3-4b8b-8708-103d6f9e63c9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:29.497694 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-62320f17-1de7-4d51-a857-37ef1a790578 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:29.498306 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-62320f17-1de7-4d51-a857-37ef1a790578 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:29.504928 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62320f17-1de7-4d51-a857-37ef1a790578 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:29.505375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62320f17-1de7-4d51-a857-37ef1a790578 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:29.506149 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62320f17-1de7-4d51-a857-37ef1a790578 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:29.506577 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-62320f17-1de7-4d51-a857-37ef1a790578 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:29.600031 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b39c98b9-7fd3-4b8b-8708-103d6f9e63c9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:29.608286 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b39c98b9-7fd3-4b8b-8708-103d6f9e63c9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1655 microversion: 2.1 time: 0.160213 Jun 23 16:08:29.608863 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 417/821] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:29 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:08:29.649512 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-62320f17-1de7-4d51-a857-37ef1a790578 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:29.657374 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-62320f17-1de7-4d51-a857-37ef1a790578 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.164165 Jun 23 16:08:29.657937 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 405/822] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:29 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:29.662497 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-40df9a3d-8697-4a18-b0c1-2a2a20273c9c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:29.668412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40df9a3d-8697-4a18-b0c1-2a2a20273c9c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:29.669573 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-40df9a3d-8697-4a18-b0c1-2a2a20273c9c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:29.691333 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-40df9a3d-8697-4a18-b0c1-2a2a20273c9c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Going to try to start instance {{(pid=117891) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 16:08:29.725967 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ead979a0-4e31-494d-b5ba-73093f7c0bea tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Action: 'create', calling method: .version_select at 0x7fe28d34a9d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2133220058", "metadata": {"Type": "work"}}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:29.734789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-40df9a3d-8697-4a18-b0c1-2a2a20273c9c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/action" status: 202 len: 0 microversion: 2.1 time: 0.075648 Jun 23 16:08:29.735382 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 406/823] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jun 23 16:08:29 2022] POST /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:08:29.743535 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fcf997ee-fb6a-45e8-bae4-e5ffebefb724 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:29.748456 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fcf997ee-fb6a-45e8-bae4-e5ffebefb724 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ead979a0-4e31-494d-b5ba-73093f7c0bea tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Request method failure captured: Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 122 Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI_91TBfrAL2IFdvvxEIk9tCTem72XKDONtpN36az8QFNpW8g4N7gx1l9Ae_FWUPkheFJzE3KA0Z34RlkpHhbAQx3ddJNsbTe-pBxge1Z2ITKySlFdGUOu1use8q3tHstmX9NQ1R2iDQ4LbxZSMEn9d9uNUJtWcYfs2rF6_jSBUbZ-M Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:08:29.750499 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_73140d3e6cdc4295a8c694af753e59b5"}]}] Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: abbac3c3fb8546abaf8b6ba207d79e7e Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2133220058", "metadata": {"Type": "work"}}} Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: Jun 23 16:08:29.752150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2133220058', 'metadata': {'Type': 'work'}}}} Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise error Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:08:29.753232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 16:08:29.754847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 16:08:29.756116 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 16:08:29.756116 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.756272 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fcf997ee-fb6a-45e8-bae4-e5ffebefb724 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:29.756272 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fcf997ee-fb6a-45e8-bae4-e5ffebefb724 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:29.756436 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ead979a0-4e31-494d-b5ba-73093f7c0bea tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:08:29.756525 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fcf997ee-fb6a-45e8-bae4-e5ffebefb724 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:29.756525 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fcf997ee-fb6a-45e8-bae4-e5ffebefb724 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:29.756688 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ead979a0-4e31-494d-b5ba-73093f7c0bea tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.142682 Jun 23 16:08:29.757639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 418/824] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Jun 23 16:08:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 16:08:29.765546 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a930e450-d302-44af-af6a-4383240ca436 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Action: 'create', calling method: .version_select at 0x7fe28d44e550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-639019845", "metadata": {"Type": "work"}}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a930e450-d302-44af-af6a-4383240ca436 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Request method failure captured: Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 119 Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI_91TBfrAL2IFdvvxEIk9tCTem72XKDONtpN36az8QFNpW8g4N7gx1l9Ae_FWUPkheFJzE3KA0Z34RlkpHhbAQx3ddJNsbTe-pBxge1Z2ITKySlFdGUOu1use8q3tHstmX9NQ1R2iDQ4LbxZSMEn9d9uNUJtWcYfs2rF6_jSBUbZ-M Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:08:29.768731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_73140d3e6cdc4295a8c694af753e59b5"}]}] Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: abbac3c3fb8546abaf8b6ba207d79e7e Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-639019845", "metadata": {"Type": "work"}}} Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: Jun 23 16:08:29.770320 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-639019845', 'metadata': {'Type': 'work'}}}} Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise error Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi '0' Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:08:29.771412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 16:08:29.773649 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 16:08:29.775423 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 16:08:29.775423 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.775423 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a930e450-d302-44af-af6a-4383240ca436 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:08:29.775423 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a930e450-d302-44af-af6a-4383240ca436 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011274 Jun 23 16:08:29.775802 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 419/825] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Jun 23 16:08:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 16:08:29.781780 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-797fe0c7-57db-4a8a-a553-c40a264ea085 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Action: 'create', calling method: .version_select at 0x7fe28d44e430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-37662472", "metadata": {"Type": "work"}}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-797fe0c7-57db-4a8a-a553-c40a264ea085 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Request method failure captured: Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 117 Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI_91TBfrAL2IFdvvxEIk9tCTem72XKDONtpN36az8QFNpW8g4N7gx1l9Ae_FWUPkheFJzE3KA0Z34RlkpHhbAQx3ddJNsbTe-pBxge1Z2ITKySlFdGUOu1use8q3tHstmX9NQ1R2iDQ4LbxZSMEn9d9uNUJtWcYfs2rF6_jSBUbZ-M Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:08:29.784117 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_73140d3e6cdc4295a8c694af753e59b5"}]}] Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: abbac3c3fb8546abaf8b6ba207d79e7e Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-37662472", "metadata": {"Type": "work"}}} Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: Jun 23 16:08:29.786341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-37662472', 'metadata': {'Type': 'work'}}}} Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise error Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi '' Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:08:29.787211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 16:08:29.788943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 16:08:29.790283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 16:08:29.790283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.790283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-797fe0c7-57db-4a8a-a553-c40a264ea085 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:08:29.790283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-797fe0c7-57db-4a8a-a553-c40a264ea085 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008948 Jun 23 16:08:29.790283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 420/826] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Jun 23 16:08:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 16:08:29.802023 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-130af464-457c-4d1a-83ff-f3348cb1b4df tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Calling method '.version_select at 0x7fe28d34a790>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:29.840873 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-130af464-457c-4d1a-83ff-f3348cb1b4df tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] HTTP exception thrown: Volume tempest-invalid-1483150475 could not be found. Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-130af464-457c-4d1a-83ff-f3348cb1b4df tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Request method failure captured: Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1483150475 HTTP/1.1 Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI_91TBfrAL2IFdvvxEIk9tCTem72XKDONtpN36az8QFNpW8g4N7gx1l9Ae_FWUPkheFJzE3KA0Z34RlkpHhbAQx3ddJNsbTe-pBxge1Z2ITKySlFdGUOu1use8q3tHstmX9NQ1R2iDQ4LbxZSMEn9d9uNUJtWcYfs2rF6_jSBUbZ-M Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:08:29.843030 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_73140d3e6cdc4295a8c694af753e59b5"}]}] Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: abbac3c3fb8546abaf8b6ba207d79e7e Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Volume tempest-invalid-1483150475 could not be found. Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': 'tempest-invalid-1483150475'} Jun 23 16:08:29.844648 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1483150475 could not be found. (HTTP 404) (Request-ID: req-ef4f86e7-ef7e-4ee4-921f-85d4ec284473) Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.849702 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 16:08:29.851000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1483150475 could not be found. Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:08:29.852085 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1483150475 could not be found. Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1483150475 could not be found. Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-130af464-457c-4d1a-83ff-f3348cb1b4df tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Returning 404 to user: Volume tempest-invalid-1483150475 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-130af464-457c-4d1a-83ff-f3348cb1b4df tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1483150475" status: 404 len: 99 microversion: 2.1 time: 0.049286 Jun 23 16:08:29.853298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 421/827] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Jun 23 16:08:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1483150475 => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 23 16:08:29.857091 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-30eba425-29a6-4392-9b6a-027e3d4425be tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005765 Jun 23 16:08:29.857883 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 422/828] 10.222.0.46 () {58 vars in 1139 bytes} [Thu Jun 23 16:08:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jun 23 16:08:29.868683 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-17386999-9bbd-44eb-8d52-ad3a4b533ecf tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003878 Jun 23 16:08:29.871146 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 423/829] 10.222.0.46 () {58 vars in 1136 bytes} [Thu Jun 23 16:08:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 16:08:29.879073 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8d4d9afe-6ff7-45c0-90be-e1d0e7f25b2b tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Calling method '.version_select at 0x7fe28d3e3dc0>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:29.908189 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-8d4d9afe-6ff7-45c0-90be-e1d0e7f25b2b tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] HTTP exception thrown: Volume 07c9c47a-4108-49ee-97bf-34f892f4b9f6 could not be found. Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8d4d9afe-6ff7-45c0-90be-e1d0e7f25b2b tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Request method failure captured: Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/os-volumes/07c9c47a-4108-49ee-97bf-34f892f4b9f6 HTTP/1.1 Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI_91TBfrAL2IFdvvxEIk9tCTem72XKDONtpN36az8QFNpW8g4N7gx1l9Ae_FWUPkheFJzE3KA0Z34RlkpHhbAQx3ddJNsbTe-pBxge1Z2ITKySlFdGUOu1use8q3tHstmX9NQ1R2iDQ4LbxZSMEn9d9uNUJtWcYfs2rF6_jSBUbZ-M Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:08:29.910224 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_73140d3e6cdc4295a8c694af753e59b5"}]}] Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: abbac3c3fb8546abaf8b6ba207d79e7e Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Volume 07c9c47a-4108-49ee-97bf-34f892f4b9f6 could not be found. Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '07c9c47a-4108-49ee-97bf-34f892f4b9f6'} Jun 23 16:08:29.911789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07c9c47a-4108-49ee-97bf-34f892f4b9f6 could not be found. (HTTP 404) (Request-ID: req-014bae4e-3314-4628-a7af-ad07f13b6e9e) Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.912689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 16:08:29.914038 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07c9c47a-4108-49ee-97bf-34f892f4b9f6 could not be found. Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 16:08:29.916195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07c9c47a-4108-49ee-97bf-34f892f4b9f6 could not be found. Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07c9c47a-4108-49ee-97bf-34f892f4b9f6 could not be found. Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8d4d9afe-6ff7-45c0-90be-e1d0e7f25b2b tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Returning 404 to user: Volume 07c9c47a-4108-49ee-97bf-34f892f4b9f6 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8d4d9afe-6ff7-45c0-90be-e1d0e7f25b2b tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/07c9c47a-4108-49ee-97bf-34f892f4b9f6" status: 404 len: 109 microversion: 2.1 time: 0.036678 Jun 23 16:08:29.919000 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 424/830] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 23 16:08:29 2022] DELETE /compute/v2.1/os-volumes/07c9c47a-4108-49ee-97bf-34f892f4b9f6 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 16:08:29.922650 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-abd64636-515c-4ba3-aa68-4dac60409b19 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Calling method '.version_select at 0x7fe28d34a310>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:29.954718 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fcf997ee-fb6a-45e8-bae4-e5ffebefb724 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:29.956255 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-abd64636-515c-4ba3-aa68-4dac60409b19 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] HTTP exception thrown: Volume 394b98f2-0871-4935-a4c1-d1627212f8fc could not be found. Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-abd64636-515c-4ba3-aa68-4dac60409b19 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Request method failure captured: Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/os-volumes/394b98f2-0871-4935-a4c1-d1627212f8fc HTTP/1.1 Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI_91TBfrAL2IFdvvxEIk9tCTem72XKDONtpN36az8QFNpW8g4N7gx1l9Ae_FWUPkheFJzE3KA0Z34RlkpHhbAQx3ddJNsbTe-pBxge1Z2ITKySlFdGUOu1use8q3tHstmX9NQ1R2iDQ4LbxZSMEn9d9uNUJtWcYfs2rF6_jSBUbZ-M Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:08:29.958226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/73140d3e6cdc4295a8c694af753e59b5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_73140d3e6cdc4295a8c694af753e59b5"}]}] Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 73140d3e6cdc4295a8c694af753e59b5 Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-VolumesNegativeTest-767483048 Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: abbac3c3fb8546abaf8b6ba207d79e7e Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-VolumesNegativeTest-767483048-project Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Volume 394b98f2-0871-4935-a4c1-d1627212f8fc could not be found. Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '394b98f2-0871-4935-a4c1-d1627212f8fc'} Jun 23 16:08:29.959589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 394b98f2-0871-4935-a4c1-d1627212f8fc could not be found. (HTTP 404) (Request-ID: req-100cd7d5-3fad-4ddd-b89e-5081142226a8) Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.963300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 16:08:29.964756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 394b98f2-0871-4935-a4c1-d1627212f8fc could not be found. Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 16:08:29.965949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 394b98f2-0871-4935-a4c1-d1627212f8fc could not be found. Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 394b98f2-0871-4935-a4c1-d1627212f8fc could not be found. Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-abd64636-515c-4ba3-aa68-4dac60409b19 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] Returning 404 to user: Volume 394b98f2-0871-4935-a4c1-d1627212f8fc could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-abd64636-515c-4ba3-aa68-4dac60409b19 tempest-VolumesNegativeTest-767483048 tempest-VolumesNegativeTest-767483048-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/394b98f2-0871-4935-a4c1-d1627212f8fc" status: 404 len: 109 microversion: 2.1 time: 0.041462 Jun 23 16:08:29.967124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 425/831] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:08:29 2022] GET /compute/v2.1/os-volumes/394b98f2-0871-4935-a4c1-d1627212f8fc => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:08:29.967966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fcf997ee-fb6a-45e8-bae4-e5ffebefb724 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1664 microversion: 2.1 time: 0.225398 Jun 23 16:08:29.967966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 407/832] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:29 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1664 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:08:30.674339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-953e3bc5-57d2-48ab-9a48-db1b2ae61dc7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:30.675613 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-953e3bc5-57d2-48ab-9a48-db1b2ae61dc7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:30.682321 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-953e3bc5-57d2-48ab-9a48-db1b2ae61dc7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:30.682960 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-953e3bc5-57d2-48ab-9a48-db1b2ae61dc7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:30.683755 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-953e3bc5-57d2-48ab-9a48-db1b2ae61dc7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:30.684192 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-953e3bc5-57d2-48ab-9a48-db1b2ae61dc7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:30.823808 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-953e3bc5-57d2-48ab-9a48-db1b2ae61dc7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:30.832034 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-953e3bc5-57d2-48ab-9a48-db1b2ae61dc7 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.161693 Jun 23 16:08:30.832597 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 426/833] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:30 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:30.982999 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-03b9cdb7-ed86-4f80-b128-fedc579f1b24 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:30.983848 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-03b9cdb7-ed86-4f80-b128-fedc579f1b24 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:30.986487 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:08:30.987167 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:08:30.993944 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03b9cdb7-ed86-4f80-b128-fedc579f1b24 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:30.994407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03b9cdb7-ed86-4f80-b128-fedc579f1b24 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:30.995270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03b9cdb7-ed86-4f80-b128-fedc579f1b24 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:30.995712 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03b9cdb7-ed86-4f80-b128-fedc579f1b24 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:31.001497 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:08:31.141060 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-03b9cdb7-ed86-4f80-b128-fedc579f1b24 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:31.152136 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-03b9cdb7-ed86-4f80-b128-fedc579f1b24 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1664 microversion: 2.1 time: 0.173474 Jun 23 16:08:31.153037 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 408/834] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:30 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:31.849061 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-67d7c1af-1993-4203-b0dc-861adaad2d2b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:31.849670 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-67d7c1af-1993-4203-b0dc-861adaad2d2b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:31.851756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:08:31.858004 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-67d7c1af-1993-4203-b0dc-861adaad2d2b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:31.858456 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-67d7c1af-1993-4203-b0dc-861adaad2d2b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:31.859262 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-67d7c1af-1993-4203-b0dc-861adaad2d2b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:31.859699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-67d7c1af-1993-4203-b0dc-861adaad2d2b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:31.997438 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-67d7c1af-1993-4203-b0dc-861adaad2d2b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:32.005390 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-67d7c1af-1993-4203-b0dc-861adaad2d2b tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.160085 Jun 23 16:08:32.005879 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 427/835] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:31 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:32.170657 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b2f1fa71-4895-4072-b4f7-b706dd7af5c4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:32.171291 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b2f1fa71-4895-4072-b4f7-b706dd7af5c4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:32.177680 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b2f1fa71-4895-4072-b4f7-b706dd7af5c4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:32.178123 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b2f1fa71-4895-4072-b4f7-b706dd7af5c4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:32.178914 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b2f1fa71-4895-4072-b4f7-b706dd7af5c4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:32.179349 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b2f1fa71-4895-4072-b4f7-b706dd7af5c4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:32.310678 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b2f1fa71-4895-4072-b4f7-b706dd7af5c4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:32.318567 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b2f1fa71-4895-4072-b4f7-b706dd7af5c4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1668 microversion: 2.1 time: 0.152418 Jun 23 16:08:32.319150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 409/836] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:32 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:33.023165 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-27571e7c-0f53-48da-8924-af3d80891306 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:33.023783 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-27571e7c-0f53-48da-8924-af3d80891306 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:33.031462 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-27571e7c-0f53-48da-8924-af3d80891306 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:33.032015 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-27571e7c-0f53-48da-8924-af3d80891306 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:33.032796 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-27571e7c-0f53-48da-8924-af3d80891306 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:33.033238 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-27571e7c-0f53-48da-8924-af3d80891306 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:33.177716 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-27571e7c-0f53-48da-8924-af3d80891306 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:33.185129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-27571e7c-0f53-48da-8924-af3d80891306 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.166264 Jun 23 16:08:33.185693 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 428/837] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:33 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:34.201876 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a0fc8ae6-97bc-49a2-8cf1-3e5a90c88669 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:34.202552 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a0fc8ae6-97bc-49a2-8cf1-3e5a90c88669 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:34.208975 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0fc8ae6-97bc-49a2-8cf1-3e5a90c88669 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:34.209340 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0fc8ae6-97bc-49a2-8cf1-3e5a90c88669 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:34.210103 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0fc8ae6-97bc-49a2-8cf1-3e5a90c88669 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:34.210537 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a0fc8ae6-97bc-49a2-8cf1-3e5a90c88669 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:34.347409 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a0fc8ae6-97bc-49a2-8cf1-3e5a90c88669 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:34.355254 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a0fc8ae6-97bc-49a2-8cf1-3e5a90c88669 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.157773 Jun 23 16:08:34.355823 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 410/838] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:34 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:35.372158 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7af74a89-5c5e-4920-8e94-fcbc1cb9b3c8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:35.372797 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7af74a89-5c5e-4920-8e94-fcbc1cb9b3c8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:35.379677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7af74a89-5c5e-4920-8e94-fcbc1cb9b3c8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:35.380162 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7af74a89-5c5e-4920-8e94-fcbc1cb9b3c8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:35.380940 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7af74a89-5c5e-4920-8e94-fcbc1cb9b3c8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:35.381374 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7af74a89-5c5e-4920-8e94-fcbc1cb9b3c8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:35.525162 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7af74a89-5c5e-4920-8e94-fcbc1cb9b3c8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:35.535019 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7af74a89-5c5e-4920-8e94-fcbc1cb9b3c8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.166727 Jun 23 16:08:35.535535 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 429/839] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:35 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:36.552198 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6ff922ad-96e6-46b2-a2e6-1c1709691c2a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:36.552964 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6ff922ad-96e6-46b2-a2e6-1c1709691c2a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:36.560443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6ff922ad-96e6-46b2-a2e6-1c1709691c2a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:36.560971 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6ff922ad-96e6-46b2-a2e6-1c1709691c2a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:36.561812 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6ff922ad-96e6-46b2-a2e6-1c1709691c2a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:36.562317 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6ff922ad-96e6-46b2-a2e6-1c1709691c2a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:36.709126 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6ff922ad-96e6-46b2-a2e6-1c1709691c2a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:36.720766 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6ff922ad-96e6-46b2-a2e6-1c1709691c2a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.172409 Jun 23 16:08:36.721365 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 411/840] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:36 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:37.689324 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-7dca0df2-1aad-4b9e-901e-3d48d459db9f req-5cc1ffe3-9ce1-495f-bb40-1a25576e2fb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebbd10bd-a125-4d68-addf-5409260490d4", "name": "network-vif-plugged", "status": "completed", "tag": "81683d16-0178-4e80-8f3d-602273915cfa"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:37.699099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7dca0df2-1aad-4b9e-901e-3d48d459db9f req-5cc1ffe3-9ce1-495f-bb40-1a25576e2fb5 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:37.699597 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7dca0df2-1aad-4b9e-901e-3d48d459db9f req-5cc1ffe3-9ce1-495f-bb40-1a25576e2fb5 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:37.711980 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-7dca0df2-1aad-4b9e-901e-3d48d459db9f req-5cc1ffe3-9ce1-495f-bb40-1a25576e2fb5 service nova] Creating event network-vif-plugged:81683d16-0178-4e80-8f3d-602273915cfa for instance ebbd10bd-a125-4d68-addf-5409260490d4 on hv-cinder-83538 Jun 23 16:08:37.717045 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-7dca0df2-1aad-4b9e-901e-3d48d459db9f req-5cc1ffe3-9ce1-495f-bb40-1a25576e2fb5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031338 Jun 23 16:08:37.717643 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 430/841] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:08:37.738021 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c3989d62-242b-4105-9131-bebcc5bd82d5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:37.739060 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c3989d62-242b-4105-9131-bebcc5bd82d5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:37.751069 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c3989d62-242b-4105-9131-bebcc5bd82d5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:37.751525 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c3989d62-242b-4105-9131-bebcc5bd82d5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:37.752913 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c3989d62-242b-4105-9131-bebcc5bd82d5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:37.753349 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c3989d62-242b-4105-9131-bebcc5bd82d5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:37.903188 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c3989d62-242b-4105-9131-bebcc5bd82d5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:37.911368 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c3989d62-242b-4105-9131-bebcc5bd82d5 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.177499 Jun 23 16:08:37.911930 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 412/842] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:37 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:38.929035 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-06e230b6-1677-4a5d-9825-fa5ffa2c34f0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:38.929731 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-06e230b6-1677-4a5d-9825-fa5ffa2c34f0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:38.935998 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-06e230b6-1677-4a5d-9825-fa5ffa2c34f0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:38.936447 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-06e230b6-1677-4a5d-9825-fa5ffa2c34f0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:38.937212 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-06e230b6-1677-4a5d-9825-fa5ffa2c34f0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:38.937668 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-06e230b6-1677-4a5d-9825-fa5ffa2c34f0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:39.071381 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-06e230b6-1677-4a5d-9825-fa5ffa2c34f0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:39.079473 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-06e230b6-1677-4a5d-9825-fa5ffa2c34f0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1267 microversion: 2.1 time: 0.155225 Jun 23 16:08:39.080033 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 431/843] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:38 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:40.097075 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5eab99c0-648a-4505-a57d-4809849a289c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:40.097813 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5eab99c0-648a-4505-a57d-4809849a289c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:40.104654 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5eab99c0-648a-4505-a57d-4809849a289c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:40.105106 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5eab99c0-648a-4505-a57d-4809849a289c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:40.105883 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5eab99c0-648a-4505-a57d-4809849a289c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:40.106896 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5eab99c0-648a-4505-a57d-4809849a289c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:40.256784 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5eab99c0-648a-4505-a57d-4809849a289c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:40.269283 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5eab99c0-648a-4505-a57d-4809849a289c tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1453 microversion: 2.1 time: 0.175839 Jun 23 16:08:40.269874 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 413/844] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:40 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:40.292164 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-14896e5b-b6a1-4f28-a953-f26505d03ea1 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:08:40.292775 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-14896e5b-b6a1-4f28-a953-f26505d03ea1 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: ebbd10bd-a125-4d68-addf-5409260490d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:08:40.300108 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-14896e5b-b6a1-4f28-a953-f26505d03ea1 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:40.303816 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-14896e5b-b6a1-4f28-a953-f26505d03ea1 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:40.304715 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-14896e5b-b6a1-4f28-a953-f26505d03ea1 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:40.305223 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-14896e5b-b6a1-4f28-a953-f26505d03ea1 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:40.459149 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-14896e5b-b6a1-4f28-a953-f26505d03ea1 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:08:40.467383 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-14896e5b-b6a1-4f28-a953-f26505d03ea1 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4" status: 200 len: 1453 microversion: 2.1 time: 0.179368 Jun 23 16:08:40.468056 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 432/845] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:08:40 2022] GET /compute/v2.1/servers/ebbd10bd-a125-4d68-addf-5409260490d4 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:08:42.329984 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-e2ad63c1-a2a5-4165-ae27-4d9a78b04754 req-126b67fd-1dfc-4c59-b154-fa5c6f718921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebbd10bd-a125-4d68-addf-5409260490d4", "tag": "81683d16-0178-4e80-8f3d-602273915cfa"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:08:42.338502 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-e2ad63c1-a2a5-4165-ae27-4d9a78b04754 req-126b67fd-1dfc-4c59-b154-fa5c6f718921 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:08:42.338966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-e2ad63c1-a2a5-4165-ae27-4d9a78b04754 req-126b67fd-1dfc-4c59-b154-fa5c6f718921 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:08:42.352576 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-e2ad63c1-a2a5-4165-ae27-4d9a78b04754 req-126b67fd-1dfc-4c59-b154-fa5c6f718921 service nova] Creating event network-changed:81683d16-0178-4e80-8f3d-602273915cfa for instance ebbd10bd-a125-4d68-addf-5409260490d4 on hv-cinder-83538 Jun 23 16:08:42.358063 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-e2ad63c1-a2a5-4165-ae27-4d9a78b04754 req-126b67fd-1dfc-4c59-b154-fa5c6f718921 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031729 Jun 23 16:08:42.358969 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 414/846] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:09:12.439119 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-91f44646-adad-451e-b7fb-b1c31cb02c4f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:12.441221 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-91f44646-adad-451e-b7fb-b1c31cb02c4f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:12.445792 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:12.447451 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=70 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:12.459718 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91f44646-adad-451e-b7fb-b1c31cb02c4f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:12.460780 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91f44646-adad-451e-b7fb-b1c31cb02c4f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:12.462184 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91f44646-adad-451e-b7fb-b1c31cb02c4f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:12.463092 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-91f44646-adad-451e-b7fb-b1c31cb02c4f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:12.497202 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-91f44646-adad-451e-b7fb-b1c31cb02c4f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/ips" status: 200 len: 148 microversion: 2.1 time: 0.066814 Jun 23 16:09:12.497775 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 433/847] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 23 16:09:12 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/ips => generated 148 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:13.810268 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:13.811040 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=36 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:13.816053 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c05baca5-4bb7-4fc7-86a3-b63a44cc7b4c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1baaf093-319c-4d27-bf1f-0775e33ad5c4"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:13.817194 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c05baca5-4bb7-4fc7-86a3-b63a44cc7b4c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:13.824999 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c05baca5-4bb7-4fc7-86a3-b63a44cc7b4c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:13.825447 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c05baca5-4bb7-4fc7-86a3-b63a44cc7b4c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:13.826244 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c05baca5-4bb7-4fc7-86a3-b63a44cc7b4c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:13.826786 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c05baca5-4bb7-4fc7-86a3-b63a44cc7b4c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:14.071173 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c05baca5-4bb7-4fc7-86a3-b63a44cc7b4c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262146 Jun 23 16:09:14.071783 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 415/848] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:09:13 2022] POST /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:21.552878 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0ea52095-ffd3-467d-9ac3-b58e256cdb58 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1baaf093-319c-4d27-bf1f-0775e33ad5c4"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:21.553941 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0ea52095-ffd3-467d-9ac3-b58e256cdb58 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:21.560595 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0ea52095-ffd3-467d-9ac3-b58e256cdb58 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:21.561037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0ea52095-ffd3-467d-9ac3-b58e256cdb58 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:21.561823 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0ea52095-ffd3-467d-9ac3-b58e256cdb58 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:21.562905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0ea52095-ffd3-467d-9ac3-b58e256cdb58 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:21.641170 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-0ea52095-ffd3-467d-9ac3-b58e256cdb58 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Invalid volume: volume 1baaf093-319c-4d27-bf1f-0775e33ad5c4 is already attached to instances: f4c3b97d-6f9a-4ce8-8081-dd5903a13761 Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0ea52095-ffd3-467d-9ac3-b58e256cdb58 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: POST /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments HTTP/1.1 Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 74 Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:09:21.642905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {"volumeAttachment": {"volumeId": "1baaf093-319c-4d27-bf1f-0775e33ad5c4"}} Jun 23 16:09:21.644336 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Invalid volume: volume 1baaf093-319c-4d27-bf1f-0775e33ad5c4 is already attached to instances: f4c3b97d-6f9a-4ce8-8081-dd5903a13761 Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'server_id': 'f4c3b97d-6f9a-4ce8-8081-dd5903a13761', 'body': {'volumeAttachment': {'volumeId': '1baaf093-319c-4d27-bf1f-0775e33ad5c4'}}} Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1baaf093-319c-4d27-bf1f-0775e33ad5c4 is already attached to instances: f4c3b97d-6f9a-4ce8-8081-dd5903a13761 Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:21.645341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1baaf093-319c-4d27-bf1f-0775e33ad5c4 is already attached to instances: f4c3b97d-6f9a-4ce8-8081-dd5903a13761 Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:09:21.646977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:09:21.648931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:09:21.648931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:09:21.648931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:09:21.648931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1baaf093-319c-4d27-bf1f-0775e33ad5c4 is already attached to instances: f4c3b97d-6f9a-4ce8-8081-dd5903a13761 Jun 23 16:09:21.648931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:21.648931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0ea52095-ffd3-467d-9ac3-b58e256cdb58 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 400 to user: Invalid volume: volume 1baaf093-319c-4d27-bf1f-0775e33ad5c4 is already attached to instances: f4c3b97d-6f9a-4ce8-8081-dd5903a13761 {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:09:21.648931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0ea52095-ffd3-467d-9ac3-b58e256cdb58 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095585 Jun 23 16:09:21.648931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 434/849] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:09:21 2022] POST /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 16:09:21.705200 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e6ecb0c3-81d8-439c-8632-4fef5f61f318 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:21.705821 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e6ecb0c3-81d8-439c-8632-4fef5f61f318 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:21.712305 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e6ecb0c3-81d8-439c-8632-4fef5f61f318 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:21.712751 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e6ecb0c3-81d8-439c-8632-4fef5f61f318 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:21.713513 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e6ecb0c3-81d8-439c-8632-4fef5f61f318 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:21.714034 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e6ecb0c3-81d8-439c-8632-4fef5f61f318 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:21.795730 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-e6ecb0c3-81d8-439c-8632-4fef5f61f318 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lazy-loading 'services' on Instance uuid f4c3b97d-6f9a-4ce8-8081-dd5903a13761 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:09:21.870949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e6ecb0c3-81d8-439c-8632-4fef5f61f318 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments/1baaf093-319c-4d27-bf1f-0775e33ad5c4" status: 202 len: 0 microversion: 2.1 time: 0.170359 Jun 23 16:09:21.871877 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 416/850] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 23 16:09:21 2022] DELETE /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments/1baaf093-319c-4d27-bf1f-0775e33ad5c4 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:09:21.880504 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bf18b0e2-adf2-47b4-b28c-6dd573f25e19 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:21.881437 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bf18b0e2-adf2-47b4-b28c-6dd573f25e19 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:21.888214 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf18b0e2-adf2-47b4-b28c-6dd573f25e19 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:21.888662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf18b0e2-adf2-47b4-b28c-6dd573f25e19 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:21.889474 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf18b0e2-adf2-47b4-b28c-6dd573f25e19 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:21.889912 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bf18b0e2-adf2-47b4-b28c-6dd573f25e19 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:21.921585 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bf18b0e2-adf2-47b4-b28c-6dd573f25e19 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Jun 23 16:09:21.922150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 435/851] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:09:21 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:22.934539 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-744a91f0-85e3-4b34-957f-6ff92b9e703e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:22.935631 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-744a91f0-85e3-4b34-957f-6ff92b9e703e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:22.942523 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-744a91f0-85e3-4b34-957f-6ff92b9e703e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:22.943013 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-744a91f0-85e3-4b34-957f-6ff92b9e703e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:22.943779 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-744a91f0-85e3-4b34-957f-6ff92b9e703e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:22.944215 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-744a91f0-85e3-4b34-957f-6ff92b9e703e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:22.973590 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-744a91f0-85e3-4b34-957f-6ff92b9e703e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043878 Jun 23 16:09:22.974144 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 417/852] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:09:22 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 16:09:23.032335 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-312d95e6-4954-472b-b9bb-a464ef1f7c71 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:23.032889 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-312d95e6-4954-472b-b9bb-a464ef1f7c71 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:23.039429 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-312d95e6-4954-472b-b9bb-a464ef1f7c71 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:23.039878 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-312d95e6-4954-472b-b9bb-a464ef1f7c71 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:23.040640 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-312d95e6-4954-472b-b9bb-a464ef1f7c71 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:23.041076 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-312d95e6-4954-472b-b9bb-a464ef1f7c71 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:23.066466 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-312d95e6-4954-472b-b9bb-a464ef1f7c71 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:09:23.141928 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-312d95e6-4954-472b-b9bb-a464ef1f7c71 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 204 len: 0 microversion: 2.1 time: 0.113152 Jun 23 16:09:23.142713 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 436/853] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:09:23 2022] DELETE /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:09:23.151924 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-0510b658-40a2-4d9b-938c-e816315adb64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:23.152534 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-0510b658-40a2-4d9b-938c-e816315adb64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:23.158437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0510b658-40a2-4d9b-938c-e816315adb64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:23.158913 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0510b658-40a2-4d9b-938c-e816315adb64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:23.159663 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0510b658-40a2-4d9b-938c-e816315adb64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:23.160094 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-0510b658-40a2-4d9b-938c-e816315adb64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:23.292078 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-0510b658-40a2-4d9b-938c-e816315adb64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:23.300109 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-0510b658-40a2-4d9b-938c-e816315adb64 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1678 microversion: 2.1 time: 0.153090 Jun 23 16:09:23.300673 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 418/854] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:23 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:24.318194 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-aef27379-c2f0-4517-81ef-6344ed2bc2a8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:24.318917 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-aef27379-c2f0-4517-81ef-6344ed2bc2a8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:24.325471 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aef27379-c2f0-4517-81ef-6344ed2bc2a8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:24.325918 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aef27379-c2f0-4517-81ef-6344ed2bc2a8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:24.326677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aef27379-c2f0-4517-81ef-6344ed2bc2a8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:24.327134 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-aef27379-c2f0-4517-81ef-6344ed2bc2a8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:24.459682 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-aef27379-c2f0-4517-81ef-6344ed2bc2a8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:24.467150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-aef27379-c2f0-4517-81ef-6344ed2bc2a8 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1678 microversion: 2.1 time: 0.153162 Jun 23 16:09:24.467709 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 437/855] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:24 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:25.484808 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7244311a-5ad8-49a5-a80c-d62bb3a21b8e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:25.485678 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7244311a-5ad8-49a5-a80c-d62bb3a21b8e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:25.492787 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7244311a-5ad8-49a5-a80c-d62bb3a21b8e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:25.493244 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7244311a-5ad8-49a5-a80c-d62bb3a21b8e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:25.494013 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7244311a-5ad8-49a5-a80c-d62bb3a21b8e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:25.494456 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7244311a-5ad8-49a5-a80c-d62bb3a21b8e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:25.717571 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7244311a-5ad8-49a5-a80c-d62bb3a21b8e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:25.725092 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7244311a-5ad8-49a5-a80c-d62bb3a21b8e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1678 microversion: 2.1 time: 0.244120 Jun 23 16:09:25.725658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 419/856] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:25 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1678 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:25.935218 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-757fc73d-8d26-4c1a-bfda-1a4da1b56b57 req-1c51ec3e-6294-479f-98cb-9dbba8237660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c3b97d-6f9a-4ce8-8081-dd5903a13761", "name": "network-vif-deleted", "tag": "db91a74b-77fc-40fb-bf12-5e5899ebd3e2"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:25.949090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-757fc73d-8d26-4c1a-bfda-1a4da1b56b57 req-1c51ec3e-6294-479f-98cb-9dbba8237660 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:25.950231 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-757fc73d-8d26-4c1a-bfda-1a4da1b56b57 req-1c51ec3e-6294-479f-98cb-9dbba8237660 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:25.971629 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-757fc73d-8d26-4c1a-bfda-1a4da1b56b57 req-1c51ec3e-6294-479f-98cb-9dbba8237660 service nova] Creating event network-vif-deleted:db91a74b-77fc-40fb-bf12-5e5899ebd3e2 for instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 on hv-cinder-83538 Jun 23 16:09:25.977599 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-757fc73d-8d26-4c1a-bfda-1a4da1b56b57 req-1c51ec3e-6294-479f-98cb-9dbba8237660 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046289 Jun 23 16:09:25.982186 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 438/857] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:26.741828 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:26.742569 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:26.750088 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:26.750544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:26.751364 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:26.751806 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:26.786617 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:26.787111 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:26.787563 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lazy-loading 'fault' on Instance uuid f4c3b97d-6f9a-4ce8-8081-dd5903a13761 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:09:26.834612 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:26.841679 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b972260f-54de-4190-ac41-89438c4cf6d7 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 200 len: 1331 microversion: 2.1 time: 0.104169 Jun 23 16:09:26.842256 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 420/858] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:26 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:27.860143 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-309a91f1-026b-4965-b536-e77ddedd6bef tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:27.861035 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-309a91f1-026b-4965-b536-e77ddedd6bef tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:27.868397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-309a91f1-026b-4965-b536-e77ddedd6bef tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:27.868842 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-309a91f1-026b-4965-b536-e77ddedd6bef tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:27.869679 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-309a91f1-026b-4965-b536-e77ddedd6bef tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:27.871151 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-309a91f1-026b-4965-b536-e77ddedd6bef tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:27.884950 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-309a91f1-026b-4965-b536-e77ddedd6bef tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-309a91f1-026b-4965-b536-e77ddedd6bef tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 HTTP/1.1 Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:09:27.886606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:09:27.888239 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': 'f4c3b97d-6f9a-4ce8-8081-dd5903a13761'} Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:09:27.891485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:09:27.892936 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:27.894373 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-309a91f1-026b-4965-b536-e77ddedd6bef tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:09:27.894373 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-309a91f1-026b-4965-b536-e77ddedd6bef tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 404 len: 111 microversion: 2.1 time: 0.032231 Jun 23 16:09:27.894373 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 439/859] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:27 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:09:27.897666 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8a5ce633-8c42-47cd-9b99-049098c01ed5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '.version_select at 0x7fe28d4184c0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:27.915258 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8a5ce633-8c42-47cd-9b99-049098c01ed5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-841223630" status: 202 len: 0 microversion: 2.1 time: 0.021580 Jun 23 16:09:27.915815 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 421/860] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Jun 23 16:09:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-841223630 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:09:28.520512 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c6d861fe-bed3-48d1-b61d-201ab664d796 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: .version_select at 0x7fe28d411d30>, body: {"keypair": {"name": "tempest-keypair-712713560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7gFv1TB6kacIPEXjWbss0dLlMAvP+h3bUm8sqIpnahAMUjVzgKUSECd10KHlWuEgOeRUqqdQs8hv3alvDgYhhA2U8sBJY9HxZXyE4ZJOHSKXd0p537PYTTyY+PlD2YtA=="}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:28.534484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-c6d861fe-bed3-48d1-b61d-201ab664d796 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for project 2063fb24abb5408794361a9032e56d3f. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:09:28.538291 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-c6d861fe-bed3-48d1-b61d-201ab664d796 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for user dac5e323b42f41859c85709a2b49623b and project 2063fb24abb5408794361a9032e56d3f. Resources: {'key_pairs'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:09:28.562758 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c6d861fe-bed3-48d1-b61d-201ab664d796 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046162 Jun 23 16:09:28.563358 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 440/861] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 23 16:09:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:29.850540 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-747251170", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "58e7bb1c-ec3e-4fa3-be98-70515568e1d4"}], "security_groups": [{"name": "tempest-securitygroup--621416827"}], "key_name": "tempest-keypair-712713560", "user_data": "}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:29.963358 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] validate_networks() for [('58e7bb1c-ec3e-4fa3-be98-70515568e1d4', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:09:30.331971 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:09:30.332399 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:09:30.332904 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:09:30.333314 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:09:30.333753 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:09:30.342881 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:30.343853 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:30.344659 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:30.345094 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:30.362063 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for project 2063fb24abb5408794361a9032e56d3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:09:30.366025 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Getting quotas for user dac5e323b42f41859c85709a2b49623b and project 2063fb24abb5408794361a9032e56d3f. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:09:30.377074 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:09:30.379346 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:09:30.427007 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c1398b81-1bfa-4afd-a593-ea0856722409 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.585710 Jun 23 16:09:30.427751 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 422/862] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:09:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:09:30.444040 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2bae45b3-7c3d-4373-a6ce-20e472fef9e0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:30.444638 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2bae45b3-7c3d-4373-a6ce-20e472fef9e0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:30.499789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2bae45b3-7c3d-4373-a6ce-20e472fef9e0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:30.506750 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2bae45b3-7c3d-4373-a6ce-20e472fef9e0 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1240 microversion: 2.1 time: 0.067231 Jun 23 16:09:30.507317 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 441/863] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:30 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:31.524569 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-44e51808-15ff-43ac-a832-06b971b28564 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:31.525192 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-44e51808-15ff-43ac-a832-06b971b28564 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:31.532923 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44e51808-15ff-43ac-a832-06b971b28564 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:31.533367 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44e51808-15ff-43ac-a832-06b971b28564 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:31.534142 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44e51808-15ff-43ac-a832-06b971b28564 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:31.534575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-44e51808-15ff-43ac-a832-06b971b28564 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:31.602886 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-44e51808-15ff-43ac-a832-06b971b28564 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:31.610235 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-44e51808-15ff-43ac-a832-06b971b28564 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1298 microversion: 2.1 time: 0.090353 Jun 23 16:09:31.610831 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 423/864] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:31 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:32.313833 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ed3798d4-1ffd-4262-aa51-d86cd0458955 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:32.314333 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ed3798d4-1ffd-4262-aa51-d86cd0458955 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:32.321200 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed3798d4-1ffd-4262-aa51-d86cd0458955 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:32.321652 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed3798d4-1ffd-4262-aa51-d86cd0458955 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:32.322433 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed3798d4-1ffd-4262-aa51-d86cd0458955 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:32.322918 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed3798d4-1ffd-4262-aa51-d86cd0458955 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:32.348768 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ed3798d4-1ffd-4262-aa51-d86cd0458955 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/ips" status: 200 len: 153 microversion: 2.20 time: 0.039116 Jun 23 16:09:32.349656 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 442/865] 10.222.0.46 () {60 vars in 1288 bytes} [Thu Jun 23 16:09:32 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/ips => generated 153 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 16:09:32.627805 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cb6cefb2-a21d-4365-a896-ed199c4817fd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:32.628948 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cb6cefb2-a21d-4365-a896-ed199c4817fd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:32.636216 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb6cefb2-a21d-4365-a896-ed199c4817fd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:32.636910 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb6cefb2-a21d-4365-a896-ed199c4817fd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:32.637878 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb6cefb2-a21d-4365-a896-ed199c4817fd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:32.638506 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cb6cefb2-a21d-4365-a896-ed199c4817fd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:32.884915 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cb6cefb2-a21d-4365-a896-ed199c4817fd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:32.893795 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cb6cefb2-a21d-4365-a896-ed199c4817fd tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1365 microversion: 2.1 time: 0.270306 Jun 23 16:09:32.894465 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 424/866] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:32 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:33.077754 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-bac5e248-3a68-4029-9ef9-f6863fd2f26f req-bed5c4f0-0c23-4e07-90b0-e001296fae1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e9ee44-03a4-42af-92f2-eb421df3a418", "tag": "259d895d-0199-477c-88c4-8e9dc152b324"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:33.088600 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-bac5e248-3a68-4029-9ef9-f6863fd2f26f req-bed5c4f0-0c23-4e07-90b0-e001296fae1d service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:33.089447 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-bac5e248-3a68-4029-9ef9-f6863fd2f26f req-bed5c4f0-0c23-4e07-90b0-e001296fae1d service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:33.111835 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-bac5e248-3a68-4029-9ef9-f6863fd2f26f req-bed5c4f0-0c23-4e07-90b0-e001296fae1d service nova] Creating event network-changed:259d895d-0199-477c-88c4-8e9dc152b324 for instance 17e9ee44-03a4-42af-92f2-eb421df3a418 on hv-cinder-83538 Jun 23 16:09:33.118706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-bac5e248-3a68-4029-9ef9-f6863fd2f26f req-bed5c4f0-0c23-4e07-90b0-e001296fae1d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045660 Jun 23 16:09:33.119356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 443/867] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:33.913127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e2b7be99-c386-4fa8-bb03-64d7760df853 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:33.913743 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e2b7be99-c386-4fa8-bb03-64d7760df853 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:33.920379 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2b7be99-c386-4fa8-bb03-64d7760df853 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:33.920772 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2b7be99-c386-4fa8-bb03-64d7760df853 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:33.922168 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2b7be99-c386-4fa8-bb03-64d7760df853 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:33.922606 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e2b7be99-c386-4fa8-bb03-64d7760df853 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:34.054567 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e2b7be99-c386-4fa8-bb03-64d7760df853 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:34.062004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e2b7be99-c386-4fa8-bb03-64d7760df853 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1365 microversion: 2.1 time: 0.152703 Jun 23 16:09:34.062563 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 425/868] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:33 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:34.338913 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a587fed7-78f0-4d0c-8905-ad038b21cdb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:34.339526 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a587fed7-78f0-4d0c-8905-ad038b21cdb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:34.346298 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a587fed7-78f0-4d0c-8905-ad038b21cdb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:34.346762 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a587fed7-78f0-4d0c-8905-ad038b21cdb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:34.347520 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a587fed7-78f0-4d0c-8905-ad038b21cdb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:34.347946 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a587fed7-78f0-4d0c-8905-ad038b21cdb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:34.370003 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-a587fed7-78f0-4d0c-8905-ad038b21cdb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lazy-loading 'flavor' on Instance uuid b7563514-d6f1-44c1-b8ae-7008e842faf8 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:09:34.628056 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a587fed7-78f0-4d0c-8905-ad038b21cdb7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "POST /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/action" status: 202 len: 0 microversion: 2.20 time: 0.293736 Jun 23 16:09:34.628704 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 444/869] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Jun 23 16:09:34 2022] POST /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 16:09:34.636746 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e4b34d18-c14a-45b4-890c-c59087c9b2d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:34.637354 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e4b34d18-c14a-45b4-890c-c59087c9b2d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:34.643942 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e4b34d18-c14a-45b4-890c-c59087c9b2d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:34.644385 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e4b34d18-c14a-45b4-890c-c59087c9b2d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:34.645138 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e4b34d18-c14a-45b4-890c-c59087c9b2d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:34.645571 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e4b34d18-c14a-45b4-890c-c59087c9b2d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:34.774170 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e4b34d18-c14a-45b4-890c-c59087c9b2d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:34.782110 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e4b34d18-c14a-45b4-890c-c59087c9b2d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:34.783652 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e4b34d18-c14a-45b4-890c-c59087c9b2d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:34.784809 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e4b34d18-c14a-45b4-890c-c59087c9b2d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.151869 Jun 23 16:09:34.785374 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 426/870] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:34 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:35.078538 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-735c219b-ef70-48dc-be78-53d7cb6b281c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:35.079199 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-735c219b-ef70-48dc-be78-53d7cb6b281c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:35.085599 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-735c219b-ef70-48dc-be78-53d7cb6b281c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:35.086048 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-735c219b-ef70-48dc-be78-53d7cb6b281c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:35.086841 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-735c219b-ef70-48dc-be78-53d7cb6b281c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:35.087282 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-735c219b-ef70-48dc-be78-53d7cb6b281c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:35.221979 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-735c219b-ef70-48dc-be78-53d7cb6b281c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:35.229626 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-735c219b-ef70-48dc-be78-53d7cb6b281c tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1365 microversion: 2.1 time: 0.155431 Jun 23 16:09:35.230178 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 445/871] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:35 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:35.803623 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7e6809dc-e915-414c-a834-7d0bf58a5164 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:35.804201 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7e6809dc-e915-414c-a834-7d0bf58a5164 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:35.810651 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e6809dc-e915-414c-a834-7d0bf58a5164 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:35.811134 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e6809dc-e915-414c-a834-7d0bf58a5164 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:35.811873 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e6809dc-e915-414c-a834-7d0bf58a5164 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:35.812299 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e6809dc-e915-414c-a834-7d0bf58a5164 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:35.941548 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7e6809dc-e915-414c-a834-7d0bf58a5164 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:35.949459 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7e6809dc-e915-414c-a834-7d0bf58a5164 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:35.951034 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7e6809dc-e915-414c-a834-7d0bf58a5164 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:35.952704 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7e6809dc-e915-414c-a834-7d0bf58a5164 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.152460 Jun 23 16:09:35.953261 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 427/872] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:35 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:36.246537 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b74d8523-7056-49d5-bfdc-f3af42ba2820 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:36.247378 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b74d8523-7056-49d5-bfdc-f3af42ba2820 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:36.255662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b74d8523-7056-49d5-bfdc-f3af42ba2820 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:36.256269 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b74d8523-7056-49d5-bfdc-f3af42ba2820 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:36.257200 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b74d8523-7056-49d5-bfdc-f3af42ba2820 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:36.257641 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b74d8523-7056-49d5-bfdc-f3af42ba2820 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:36.388079 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b74d8523-7056-49d5-bfdc-f3af42ba2820 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:36.396327 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b74d8523-7056-49d5-bfdc-f3af42ba2820 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1365 microversion: 2.1 time: 0.153994 Jun 23 16:09:36.396884 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 446/873] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:36 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:36.971993 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-080e0d45-a70f-4376-83ad-b0500502451e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:36.972597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-080e0d45-a70f-4376-83ad-b0500502451e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:36.978995 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-080e0d45-a70f-4376-83ad-b0500502451e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:36.979429 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-080e0d45-a70f-4376-83ad-b0500502451e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:36.980171 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-080e0d45-a70f-4376-83ad-b0500502451e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:36.980594 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-080e0d45-a70f-4376-83ad-b0500502451e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:37.114295 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-080e0d45-a70f-4376-83ad-b0500502451e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:37.122297 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-080e0d45-a70f-4376-83ad-b0500502451e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:37.123844 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-080e0d45-a70f-4376-83ad-b0500502451e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:37.125016 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-080e0d45-a70f-4376-83ad-b0500502451e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.157484 Jun 23 16:09:37.125568 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 428/874] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:36 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:37.414861 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-59b04042-dc25-4529-9a3a-5ffcd275df9f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:37.415508 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-59b04042-dc25-4529-9a3a-5ffcd275df9f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:37.421996 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59b04042-dc25-4529-9a3a-5ffcd275df9f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:37.422445 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59b04042-dc25-4529-9a3a-5ffcd275df9f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:37.423234 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59b04042-dc25-4529-9a3a-5ffcd275df9f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:37.423675 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59b04042-dc25-4529-9a3a-5ffcd275df9f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:37.552893 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-59b04042-dc25-4529-9a3a-5ffcd275df9f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:37.560591 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-59b04042-dc25-4529-9a3a-5ffcd275df9f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1365 microversion: 2.1 time: 0.150395 Jun 23 16:09:37.561169 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 447/875] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:37 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:38.142486 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ee46b845-22f3-47b0-b9d2-09444d17aba0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:38.143157 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ee46b845-22f3-47b0-b9d2-09444d17aba0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:38.149887 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee46b845-22f3-47b0-b9d2-09444d17aba0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:38.150331 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee46b845-22f3-47b0-b9d2-09444d17aba0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:38.151128 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee46b845-22f3-47b0-b9d2-09444d17aba0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:38.151560 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ee46b845-22f3-47b0-b9d2-09444d17aba0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:38.281675 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ee46b845-22f3-47b0-b9d2-09444d17aba0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:38.289572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ee46b845-22f3-47b0-b9d2-09444d17aba0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:38.291092 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-ee46b845-22f3-47b0-b9d2-09444d17aba0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:38.292250 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ee46b845-22f3-47b0-b9d2-09444d17aba0 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.153650 Jun 23 16:09:38.292808 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 429/876] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:38 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:38.577430 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-350e8fad-9819-4dbf-bfdc-468eca9bf0e6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:38.578455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-350e8fad-9819-4dbf-bfdc-468eca9bf0e6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:38.585508 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-350e8fad-9819-4dbf-bfdc-468eca9bf0e6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:38.585956 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-350e8fad-9819-4dbf-bfdc-468eca9bf0e6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:38.586760 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-350e8fad-9819-4dbf-bfdc-468eca9bf0e6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:38.587201 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-350e8fad-9819-4dbf-bfdc-468eca9bf0e6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:38.713723 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-350e8fad-9819-4dbf-bfdc-468eca9bf0e6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:38.722212 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-350e8fad-9819-4dbf-bfdc-468eca9bf0e6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1365 microversion: 2.1 time: 0.148841 Jun 23 16:09:38.722898 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 448/877] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:38 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:39.233931 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-540aaa2c-c95c-4510-bb19-1ad8eeccd540 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:39.234937 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-540aaa2c-c95c-4510-bb19-1ad8eeccd540 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:39.241319 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-540aaa2c-c95c-4510-bb19-1ad8eeccd540 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:39.241762 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-540aaa2c-c95c-4510-bb19-1ad8eeccd540 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:39.242508 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-540aaa2c-c95c-4510-bb19-1ad8eeccd540 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:39.242967 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-540aaa2c-c95c-4510-bb19-1ad8eeccd540 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:39.268575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:39.273583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-540aaa2c-c95c-4510-bb19-1ad8eeccd540 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043586 Jun 23 16:09:39.274139 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 430/878] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:09:39 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 16:09:39.310397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9395e66a-62b2-4862-9ad2-fea32f3a8a12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:39.311037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9395e66a-62b2-4862-9ad2-fea32f3a8a12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:39.320762 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9395e66a-62b2-4862-9ad2-fea32f3a8a12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:39.321206 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9395e66a-62b2-4862-9ad2-fea32f3a8a12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:39.321979 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9395e66a-62b2-4862-9ad2-fea32f3a8a12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:39.322539 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9395e66a-62b2-4862-9ad2-fea32f3a8a12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:39.331009 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6d532d8f-d266-43b1-9ad1-988062ed8643 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:39.331517 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6d532d8f-d266-43b1-9ad1-988062ed8643 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:39.338390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d532d8f-d266-43b1-9ad1-988062ed8643 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:39.338875 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d532d8f-d266-43b1-9ad1-988062ed8643 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:39.339767 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d532d8f-d266-43b1-9ad1-988062ed8643 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:39.340067 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6d532d8f-d266-43b1-9ad1-988062ed8643 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:39.364956 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6d532d8f-d266-43b1-9ad1-988062ed8643 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:09:39.448473 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6d532d8f-d266-43b1-9ad1-988062ed8643 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 204 len: 0 microversion: 2.1 time: 0.121522 Jun 23 16:09:39.449607 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 431/879] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:09:39 2022] DELETE /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 16:09:39.458309 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9395e66a-62b2-4862-9ad2-fea32f3a8a12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:39.460756 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-82bda183-7048-4814-8367-9982413107b1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:39.461467 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-82bda183-7048-4814-8367-9982413107b1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:39.466964 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9395e66a-62b2-4862-9ad2-fea32f3a8a12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:39.467924 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82bda183-7048-4814-8367-9982413107b1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:39.468378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82bda183-7048-4814-8367-9982413107b1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:39.468545 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9395e66a-62b2-4862-9ad2-fea32f3a8a12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:39.469139 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82bda183-7048-4814-8367-9982413107b1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:39.469577 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-82bda183-7048-4814-8367-9982413107b1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:39.469692 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9395e66a-62b2-4862-9ad2-fea32f3a8a12 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.163208 Jun 23 16:09:39.470251 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 449/880] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:39 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:39.599274 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-82bda183-7048-4814-8367-9982413107b1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:39.606705 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-82bda183-7048-4814-8367-9982413107b1 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1674 microversion: 2.1 time: 0.151001 Jun 23 16:09:39.607276 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 432/881] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:39 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:09:39.739544 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-457343f6-1ad1-4947-b777-730a2b95c99f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:39.740096 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-457343f6-1ad1-4947-b777-730a2b95c99f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:39.746668 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-457343f6-1ad1-4947-b777-730a2b95c99f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:39.747187 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-457343f6-1ad1-4947-b777-730a2b95c99f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:39.747913 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-457343f6-1ad1-4947-b777-730a2b95c99f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:39.748349 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-457343f6-1ad1-4947-b777-730a2b95c99f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:39.767296 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:39.889987 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-457343f6-1ad1-4947-b777-730a2b95c99f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:39.899791 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-457343f6-1ad1-4947-b777-730a2b95c99f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1365 microversion: 2.1 time: 0.164296 Jun 23 16:09:39.900379 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 450/882] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:39 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:40.062651 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-eab79508-e9d0-4cba-b36b-d02fc43b4432 req-38179f1e-7190-4111-a8af-9adbd30f9129 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e9ee44-03a4-42af-92f2-eb421df3a418", "name": "network-vif-plugged", "status": "completed", "tag": "259d895d-0199-477c-88c4-8e9dc152b324"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:40.071355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-eab79508-e9d0-4cba-b36b-d02fc43b4432 req-38179f1e-7190-4111-a8af-9adbd30f9129 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:40.071995 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-eab79508-e9d0-4cba-b36b-d02fc43b4432 req-38179f1e-7190-4111-a8af-9adbd30f9129 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:40.086176 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-eab79508-e9d0-4cba-b36b-d02fc43b4432 req-38179f1e-7190-4111-a8af-9adbd30f9129 service nova] Creating event network-vif-plugged:259d895d-0199-477c-88c4-8e9dc152b324 for instance 17e9ee44-03a4-42af-92f2-eb421df3a418 on hv-cinder-83538 Jun 23 16:09:40.091591 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-eab79508-e9d0-4cba-b36b-d02fc43b4432 req-38179f1e-7190-4111-a8af-9adbd30f9129 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033097 Jun 23 16:09:40.092164 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 433/883] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:40.488490 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0bf694b1-08ee-40d2-ba07-72ed03371c13 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:40.489101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0bf694b1-08ee-40d2-ba07-72ed03371c13 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:40.495724 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0bf694b1-08ee-40d2-ba07-72ed03371c13 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:40.496176 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0bf694b1-08ee-40d2-ba07-72ed03371c13 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:40.496946 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0bf694b1-08ee-40d2-ba07-72ed03371c13 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:40.497385 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0bf694b1-08ee-40d2-ba07-72ed03371c13 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:40.503644 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=6 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:40.625523 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8bab2f03-7241-449e-a7d8-e947e2f1ba5d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:40.626470 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8bab2f03-7241-449e-a7d8-e947e2f1ba5d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:40.630869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:40.631745 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:40.631881 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0bf694b1-08ee-40d2-ba07-72ed03371c13 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:40.636821 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8bab2f03-7241-449e-a7d8-e947e2f1ba5d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:40.637475 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8bab2f03-7241-449e-a7d8-e947e2f1ba5d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:40.638577 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8bab2f03-7241-449e-a7d8-e947e2f1ba5d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:40.639111 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8bab2f03-7241-449e-a7d8-e947e2f1ba5d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:40.641311 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0bf694b1-08ee-40d2-ba07-72ed03371c13 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:40.642913 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0bf694b1-08ee-40d2-ba07-72ed03371c13 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:40.644065 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0bf694b1-08ee-40d2-ba07-72ed03371c13 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.159624 Jun 23 16:09:40.644861 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 451/884] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:40 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:40.772039 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8bab2f03-7241-449e-a7d8-e947e2f1ba5d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:40.779816 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8bab2f03-7241-449e-a7d8-e947e2f1ba5d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1674 microversion: 2.1 time: 0.159673 Jun 23 16:09:40.780379 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 434/885] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:40 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:09:40.921388 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a60d5bc8-85fd-41ed-88fb-fef4c2c4e3af tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:40.921999 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a60d5bc8-85fd-41ed-88fb-fef4c2c4e3af tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:40.928475 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a60d5bc8-85fd-41ed-88fb-fef4c2c4e3af tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:40.928918 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a60d5bc8-85fd-41ed-88fb-fef4c2c4e3af tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:40.929676 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a60d5bc8-85fd-41ed-88fb-fef4c2c4e3af tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:40.930112 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a60d5bc8-85fd-41ed-88fb-fef4c2c4e3af tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:41.064678 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a60d5bc8-85fd-41ed-88fb-fef4c2c4e3af tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:41.072108 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a60d5bc8-85fd-41ed-88fb-fef4c2c4e3af tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1365 microversion: 2.1 time: 0.154659 Jun 23 16:09:41.072662 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 452/886] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:40 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:41.662533 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e107ae4e-cc45-49b3-a1fc-c260ecc18e7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:41.663203 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e107ae4e-cc45-49b3-a1fc-c260ecc18e7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:41.669630 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e107ae4e-cc45-49b3-a1fc-c260ecc18e7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:41.670072 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e107ae4e-cc45-49b3-a1fc-c260ecc18e7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:41.670862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e107ae4e-cc45-49b3-a1fc-c260ecc18e7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:41.671298 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e107ae4e-cc45-49b3-a1fc-c260ecc18e7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:41.797597 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7d0feb99-a44b-4bd7-9f3f-1c77d04bea7c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:41.798205 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7d0feb99-a44b-4bd7-9f3f-1c77d04bea7c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:41.804202 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d0feb99-a44b-4bd7-9f3f-1c77d04bea7c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:41.804640 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d0feb99-a44b-4bd7-9f3f-1c77d04bea7c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:41.805401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d0feb99-a44b-4bd7-9f3f-1c77d04bea7c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:41.805942 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7d0feb99-a44b-4bd7-9f3f-1c77d04bea7c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:41.876114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e107ae4e-cc45-49b3-a1fc-c260ecc18e7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:41.884556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e107ae4e-cc45-49b3-a1fc-c260ecc18e7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:41.886063 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e107ae4e-cc45-49b3-a1fc-c260ecc18e7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:41.887260 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e107ae4e-cc45-49b3-a1fc-c260ecc18e7d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.228671 Jun 23 16:09:41.888017 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 435/887] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:41 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:41.934537 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7d0feb99-a44b-4bd7-9f3f-1c77d04bea7c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:41.942823 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7d0feb99-a44b-4bd7-9f3f-1c77d04bea7c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1674 microversion: 2.1 time: 0.149660 Jun 23 16:09:41.943997 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 453/888] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:41 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:09:42.088949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-79dfba4d-1290-439a-95cb-0574d83fde17 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:42.089687 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-79dfba4d-1290-439a-95cb-0574d83fde17 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:42.096336 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79dfba4d-1290-439a-95cb-0574d83fde17 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:42.096892 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79dfba4d-1290-439a-95cb-0574d83fde17 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:42.097735 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79dfba4d-1290-439a-95cb-0574d83fde17 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:42.098172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-79dfba4d-1290-439a-95cb-0574d83fde17 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:42.342383 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-79dfba4d-1290-439a-95cb-0574d83fde17 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:42.350763 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-79dfba4d-1290-439a-95cb-0574d83fde17 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1365 microversion: 2.1 time: 0.265581 Jun 23 16:09:42.351346 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 436/889] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:42 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1365 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:42.503790 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-55c1f41b-b56b-4bee-89a2-4dcd6af26b04 req-6145dc18-7b17-45be-8593-f0b4d505bdf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f780c86-8efc-4e87-be01-8cc68d03e036", "name": "network-vif-deleted", "tag": "d0385da0-a330-4afb-a25d-690b7056b15d"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:42.508356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:42.515766 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-55c1f41b-b56b-4bee-89a2-4dcd6af26b04 req-6145dc18-7b17-45be-8593-f0b4d505bdf8 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:42.516390 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-55c1f41b-b56b-4bee-89a2-4dcd6af26b04 req-6145dc18-7b17-45be-8593-f0b4d505bdf8 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:42.534591 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-55c1f41b-b56b-4bee-89a2-4dcd6af26b04 req-6145dc18-7b17-45be-8593-f0b4d505bdf8 service nova] Creating event network-vif-deleted:d0385da0-a330-4afb-a25d-690b7056b15d for instance 8f780c86-8efc-4e87-be01-8cc68d03e036 on hv-cinder-83538 Jun 23 16:09:42.541011 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-55c1f41b-b56b-4bee-89a2-4dcd6af26b04 req-6145dc18-7b17-45be-8593-f0b4d505bdf8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042007 Jun 23 16:09:42.541859 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 454/890] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:42.910559 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c1d0034c-8aa4-4900-9cec-3d039c019a1f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:42.912433 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c1d0034c-8aa4-4900-9cec-3d039c019a1f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:42.919701 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1d0034c-8aa4-4900-9cec-3d039c019a1f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:42.920390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1d0034c-8aa4-4900-9cec-3d039c019a1f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:42.921696 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1d0034c-8aa4-4900-9cec-3d039c019a1f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:42.922136 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c1d0034c-8aa4-4900-9cec-3d039c019a1f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:42.961580 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:42.963695 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:42.971368 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:42.971838 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:42.977955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:42.989233 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:43.030638 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:43.031524 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:43.032147 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lazy-loading 'fault' on Instance uuid 8f780c86-8efc-4e87-be01-8cc68d03e036 {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:09:43.080182 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:43.087424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-59c03338-ffc2-4328-a48b-719f9a67d973 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 200 len: 1328 microversion: 2.1 time: 0.130214 Jun 23 16:09:43.087995 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 455/891] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:42 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 1328 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:43.097792 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c1d0034c-8aa4-4900-9cec-3d039c019a1f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:43.106004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c1d0034c-8aa4-4900-9cec-3d039c019a1f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:43.107520 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c1d0034c-8aa4-4900-9cec-3d039c019a1f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:43.109235 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c1d0034c-8aa4-4900-9cec-3d039c019a1f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.205024 Jun 23 16:09:43.109781 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 437/892] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:42 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:43.370218 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d6648a1d-b654-4770-899c-1bbee5308a38 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:43.371258 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d6648a1d-b654-4770-899c-1bbee5308a38 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:43.377740 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d6648a1d-b654-4770-899c-1bbee5308a38 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:43.378273 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d6648a1d-b654-4770-899c-1bbee5308a38 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:43.379151 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d6648a1d-b654-4770-899c-1bbee5308a38 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:43.379668 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d6648a1d-b654-4770-899c-1bbee5308a38 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:43.512519 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d6648a1d-b654-4770-899c-1bbee5308a38 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:43.520697 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d6648a1d-b654-4770-899c-1bbee5308a38 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1555 microversion: 2.1 time: 0.155442 Jun 23 16:09:43.521430 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 456/893] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:43 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1555 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:43.538498 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-af54df13-9c87-4de5-9826-b26e590517fe tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:43.539011 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-af54df13-9c87-4de5-9826-b26e590517fe tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:43.545182 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af54df13-9c87-4de5-9826-b26e590517fe tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:43.545831 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af54df13-9c87-4de5-9826-b26e590517fe tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:43.546393 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af54df13-9c87-4de5-9826-b26e590517fe tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:43.546848 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-af54df13-9c87-4de5-9826-b26e590517fe tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:43.626352 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-af54df13-9c87-4de5-9826-b26e590517fe tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091771 Jun 23 16:09:43.627111 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 438/894] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 23 16:09:43 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:09:44.104693 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1cd4ee68-abef-42c4-bfbd-f619eed0a567 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:44.105309 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1cd4ee68-abef-42c4-bfbd-f619eed0a567 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 8f780c86-8efc-4e87-be01-8cc68d03e036] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:44.111972 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1cd4ee68-abef-42c4-bfbd-f619eed0a567 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:44.112429 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1cd4ee68-abef-42c4-bfbd-f619eed0a567 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:44.113204 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1cd4ee68-abef-42c4-bfbd-f619eed0a567 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:44.113643 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1cd4ee68-abef-42c4-bfbd-f619eed0a567 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:44.128550 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-1cd4ee68-abef-42c4-bfbd-f619eed0a567 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] HTTP exception thrown: Instance 8f780c86-8efc-4e87-be01-8cc68d03e036 could not be found. Jun 23 16:09:44.129602 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b482ef3d-1615-4ceb-8304-89c98cbcad44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1cd4ee68-abef-42c4-bfbd-f619eed0a567 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Request method failure captured: Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 HTTP/1.1 Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI7CmvIfI4wkHIl6kJo84ScnQd4GhXA8g_s1I3F5jlC--572KPkrL3HT0vjg-aEGd0BSqe1YBuOc6ypAz21rJBLh4Ns-E3CBDDmJnqMnS-EO9ORR4CBcS_OhvhN_xblSqz8-HS6nWWMpnyBa8vAzPXUcnxoVE8nxAD89zRk1zx4fZgE Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 3e09ed68cdf94f5a83ae9581419aa876 Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeTestJSON-416645996 Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:09:44.130226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e09ed68cdf94f5a83ae9581419aa876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3e09ed68cdf94f5a83ae9581419aa876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e09ed68cdf94f5a83ae9581419aa876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3e09ed68cdf94f5a83ae9581419aa876"}]}] Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeTestJSON-416645996 Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 3e09ed68cdf94f5a83ae9581419aa876 Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeTestJSON-416645996 Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeTestJSON-416645996-project Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: b423368e84084ac89334f13b723c6b31 Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeTestJSON-416645996-project Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 8f780c86-8efc-4e87-be01-8cc68d03e036 could not be found. Jun 23 16:09:44.131611 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '8f780c86-8efc-4e87-be01-8cc68d03e036'} Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f780c86-8efc-4e87-be01-8cc68d03e036 could not be found. Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:09:44.132386 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f780c86-8efc-4e87-be01-8cc68d03e036 could not be found. Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f780c86-8efc-4e87-be01-8cc68d03e036 could not be found. Jun 23 16:09:44.133623 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:09:44.137554 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b482ef3d-1615-4ceb-8304-89c98cbcad44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:44.138207 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1cd4ee68-abef-42c4-bfbd-f619eed0a567 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Returning 404 to user: Instance 8f780c86-8efc-4e87-be01-8cc68d03e036 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:09:44.138207 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1cd4ee68-abef-42c4-bfbd-f619eed0a567 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036" status: 404 len: 111 microversion: 2.1 time: 0.030900 Jun 23 16:09:44.138207 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 457/895] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:44 2022] GET /compute/v2.1/servers/8f780c86-8efc-4e87-be01-8cc68d03e036 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:09:44.138731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:44.138731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b482ef3d-1615-4ceb-8304-89c98cbcad44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:44.139337 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b482ef3d-1615-4ceb-8304-89c98cbcad44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:44.140194 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b482ef3d-1615-4ceb-8304-89c98cbcad44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:44.140523 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b482ef3d-1615-4ceb-8304-89c98cbcad44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:44.140712 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-01950355-1cdf-4071-a38a-6e6407f9426e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '.version_select at 0x7fe28d47de50>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:44.160589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-01950355-1cdf-4071-a38a-6e6407f9426e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294029258" status: 202 len: 0 microversion: 2.1 time: 0.023548 Jun 23 16:09:44.161556 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 458/896] 10.222.0.46 () {58 vars in 1220 bytes} [Thu Jun 23 16:09:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1294029258 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 16:09:44.353312 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b482ef3d-1615-4ceb-8304-89c98cbcad44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:44.362013 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b482ef3d-1615-4ceb-8304-89c98cbcad44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:44.363551 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b482ef3d-1615-4ceb-8304-89c98cbcad44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:44.364731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b482ef3d-1615-4ceb-8304-89c98cbcad44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.239647 Jun 23 16:09:44.365290 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 439/897] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:44 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:09:44.723885 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-9e945004-81d8-4366-8fc2-9683c91724a0 req-482c143c-4a36-421a-bb9f-4e656362e4f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17e9ee44-03a4-42af-92f2-eb421df3a418", "tag": "259d895d-0199-477c-88c4-8e9dc152b324"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:44.732934 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-9e945004-81d8-4366-8fc2-9683c91724a0 req-482c143c-4a36-421a-bb9f-4e656362e4f2 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:44.734205 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-9e945004-81d8-4366-8fc2-9683c91724a0 req-482c143c-4a36-421a-bb9f-4e656362e4f2 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:44.744963 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-9e945004-81d8-4366-8fc2-9683c91724a0 req-482c143c-4a36-421a-bb9f-4e656362e4f2 service nova] Creating event network-changed:259d895d-0199-477c-88c4-8e9dc152b324 for instance 17e9ee44-03a4-42af-92f2-eb421df3a418 on hv-cinder-83538 Jun 23 16:09:44.750270 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-9e945004-81d8-4366-8fc2-9683c91724a0 req-482c143c-4a36-421a-bb9f-4e656362e4f2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030104 Jun 23 16:09:44.751001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 459/898] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:45.274412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-505eb5bf-298f-4734-8b8b-9f0b1e1c6929 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'create', calling method: .version_select at 0x7fe28d424940>, body: {"keypair": {"name": "tempest-keypair-1347771122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFy7JqicikeQ8utLiMGGOeTieSPHzww7RhQOR9v6zKXVVGkVi5jTnc0BaxZYy4pZTsZKVNlBkPT4+6/DC1zxeHgWS4ybgjb5TSv2iUiVP0nXvQB0zXX7h1gdTcSuuGSQXA=="}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:45.290004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-505eb5bf-298f-4734-8b8b-9f0b1e1c6929 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Getting quotas for project 3e09ed68cdf94f5a83ae9581419aa876. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:09:45.294274 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-505eb5bf-298f-4734-8b8b-9f0b1e1c6929 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Getting quotas for user b423368e84084ac89334f13b723c6b31 and project 3e09ed68cdf94f5a83ae9581419aa876. Resources: {'key_pairs'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:09:45.325809 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-505eb5bf-298f-4734-8b8b-9f0b1e1c6929 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055269 Jun 23 16:09:45.326796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 440/899] 10.222.0.46 () {60 vars in 1158 bytes} [Thu Jun 23 16:09:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:45.385356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0be7172b-c7e0-4eb6-b5be-332b1c263b9f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:45.386164 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0be7172b-c7e0-4eb6-b5be-332b1c263b9f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:45.393318 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0be7172b-c7e0-4eb6-b5be-332b1c263b9f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:45.394101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0be7172b-c7e0-4eb6-b5be-332b1c263b9f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:45.394982 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0be7172b-c7e0-4eb6-b5be-332b1c263b9f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:45.395489 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0be7172b-c7e0-4eb6-b5be-332b1c263b9f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:45.592150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0be7172b-c7e0-4eb6-b5be-332b1c263b9f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:45.602310 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0be7172b-c7e0-4eb6-b5be-332b1c263b9f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:45.603977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-0be7172b-c7e0-4eb6-b5be-332b1c263b9f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:45.605138 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0be7172b-c7e0-4eb6-b5be-332b1c263b9f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.225225 Jun 23 16:09:45.605882 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 460/900] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:45 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:46.624313 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b39b3776-1b29-449e-ba54-2254d0ccb632 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:46.625031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b39b3776-1b29-449e-ba54-2254d0ccb632 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:46.632994 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b39b3776-1b29-449e-ba54-2254d0ccb632 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:46.633700 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b39b3776-1b29-449e-ba54-2254d0ccb632 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:46.634476 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b39b3776-1b29-449e-ba54-2254d0ccb632 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:46.634943 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b39b3776-1b29-449e-ba54-2254d0ccb632 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:46.874162 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b39b3776-1b29-449e-ba54-2254d0ccb632 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:46.882148 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b39b3776-1b29-449e-ba54-2254d0ccb632 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:46.883674 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-b39b3776-1b29-449e-ba54-2254d0ccb632 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:46.884837 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b39b3776-1b29-449e-ba54-2254d0ccb632 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.265127 Jun 23 16:09:46.885396 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 441/901] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:46 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:47.025094 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-60500572", "imageRef": "25057213-bd45-4999-939e-6b02c23f9066", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4cf406d0-423b-4264-bd93-a82d988eee3d"}], "security_groups": [{"name": "tempest-securitygroup--2092308160"}], "key_name": "tempest-keypair-1347771122", "user_data": "}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:47.130121 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.network.neutron [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] validate_networks() for [('4cf406d0-423b-4264-bd93-a82d988eee3d', None, None, None, None, None)] {{(pid=117890) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:09:47.497939 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Flavor limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:09:47.498350 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Image limits 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:09:47.499354 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Flavor pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:09:47.499759 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Image pref 0:0:0 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:09:47.500171 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.virt.hardware [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117890) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:09:47.509736 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:47.510398 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:47.511380 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:47.511946 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:47.531881 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Getting quotas for project 3e09ed68cdf94f5a83ae9581419aa876. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:09:47.535747 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.quota [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Getting quotas for user b423368e84084ac89334f13b723c6b31 and project 3e09ed68cdf94f5a83ae9581419aa876. Resources: {'instances', 'cores', 'ram'} {{(pid=117890) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:09:47.546567 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Going to run 1 instances... {{(pid=117890) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:09:47.549321 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='25057213-bd45-4999-939e-6b02c23f9066',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117890) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:09:47.597962 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-3d039129-c632-4a80-911b-f9129281a39c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.577438 Jun 23 16:09:47.598614 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 461/902] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:09:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:09:47.608746 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7f30d75f-38da-4648-bb2d-d61b2ec6006d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:47.609498 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7f30d75f-38da-4648-bb2d-d61b2ec6006d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:47.663664 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7f30d75f-38da-4648-bb2d-d61b2ec6006d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:47.670830 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7f30d75f-38da-4648-bb2d-d61b2ec6006d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1236 microversion: 2.1 time: 0.065680 Jun 23 16:09:47.671473 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 442/903] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:47 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1236 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:47.904161 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-103b8c43-5c99-4421-b2c1-bf033bcd903f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:47.905632 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-103b8c43-5c99-4421-b2c1-bf033bcd903f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:47.912100 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-103b8c43-5c99-4421-b2c1-bf033bcd903f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:47.912587 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-103b8c43-5c99-4421-b2c1-bf033bcd903f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:47.913394 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-103b8c43-5c99-4421-b2c1-bf033bcd903f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:47.913860 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-103b8c43-5c99-4421-b2c1-bf033bcd903f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:48.067540 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-103b8c43-5c99-4421-b2c1-bf033bcd903f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:48.075799 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-103b8c43-5c99-4421-b2c1-bf033bcd903f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:48.077829 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-103b8c43-5c99-4421-b2c1-bf033bcd903f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:48.079043 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-103b8c43-5c99-4421-b2c1-bf033bcd903f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1745 microversion: 2.20 time: 0.178836 Jun 23 16:09:48.079625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 462/904] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:47 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:48.688818 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c6c8e802-2797-4f1a-89a4-934569618998 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:48.689379 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c6c8e802-2797-4f1a-89a4-934569618998 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:48.696817 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c6c8e802-2797-4f1a-89a4-934569618998 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:48.697268 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c6c8e802-2797-4f1a-89a4-934569618998 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:48.698039 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c6c8e802-2797-4f1a-89a4-934569618998 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:48.698477 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c6c8e802-2797-4f1a-89a4-934569618998 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:48.791579 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c6c8e802-2797-4f1a-89a4-934569618998 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:48.799462 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c6c8e802-2797-4f1a-89a4-934569618998 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1294 microversion: 2.1 time: 0.115433 Jun 23 16:09:48.800028 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 443/905] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:48 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1294 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:49.098515 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-05542420-27a8-43ba-bbe9-7fef897bae5c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:49.099270 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-05542420-27a8-43ba-bbe9-7fef897bae5c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:49.105745 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-05542420-27a8-43ba-bbe9-7fef897bae5c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:49.106189 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-05542420-27a8-43ba-bbe9-7fef897bae5c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:49.107095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-05542420-27a8-43ba-bbe9-7fef897bae5c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:49.107548 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-05542420-27a8-43ba-bbe9-7fef897bae5c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:49.245788 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-05542420-27a8-43ba-bbe9-7fef897bae5c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:49.254518 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-05542420-27a8-43ba-bbe9-7fef897bae5c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:49.256460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-05542420-27a8-43ba-bbe9-7fef897bae5c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:49.257667 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-05542420-27a8-43ba-bbe9-7fef897bae5c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1745 microversion: 2.20 time: 0.163311 Jun 23 16:09:49.258228 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 463/906] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:49 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:49.817269 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6c0f9da8-11dd-43e3-82b8-8b24a47634d5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:49.817886 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6c0f9da8-11dd-43e3-82b8-8b24a47634d5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:49.824782 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c0f9da8-11dd-43e3-82b8-8b24a47634d5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:49.825225 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c0f9da8-11dd-43e3-82b8-8b24a47634d5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:49.826008 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c0f9da8-11dd-43e3-82b8-8b24a47634d5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:49.826438 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6c0f9da8-11dd-43e3-82b8-8b24a47634d5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:49.961382 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-7a1d3ea8-de55-421b-a366-c4f326eca427 req-5c8bf3ca-ee16-4a0c-b29a-a22a8cf00a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81c71b24-1c7c-409e-acac-c6946af2692c", "tag": "09f5835c-4231-4c60-92b4-d34edd7b9267"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:49.972279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7a1d3ea8-de55-421b-a366-c4f326eca427 req-5c8bf3ca-ee16-4a0c-b29a-a22a8cf00a67 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:49.973137 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7a1d3ea8-de55-421b-a366-c4f326eca427 req-5c8bf3ca-ee16-4a0c-b29a-a22a8cf00a67 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:49.998199 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-7a1d3ea8-de55-421b-a366-c4f326eca427 req-5c8bf3ca-ee16-4a0c-b29a-a22a8cf00a67 service nova] Creating event network-changed:09f5835c-4231-4c60-92b4-d34edd7b9267 for instance 81c71b24-1c7c-409e-acac-c6946af2692c on hv-cinder-83538 Jun 23 16:09:50.005858 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-7a1d3ea8-de55-421b-a366-c4f326eca427 req-5c8bf3ca-ee16-4a0c-b29a-a22a8cf00a67 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049013 Jun 23 16:09:50.007191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 464/907] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:09:50.159674 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-6c0f9da8-11dd-43e3-82b8-8b24a47634d5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:50.167823 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6c0f9da8-11dd-43e3-82b8-8b24a47634d5 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1362 microversion: 2.1 time: 0.354404 Jun 23 16:09:50.168652 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 444/908] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:49 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:50.278195 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-51f5a297-0ec8-4f52-9f5d-0ff67f8a14d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:50.279259 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-51f5a297-0ec8-4f52-9f5d-0ff67f8a14d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:50.286001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51f5a297-0ec8-4f52-9f5d-0ff67f8a14d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:50.286477 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51f5a297-0ec8-4f52-9f5d-0ff67f8a14d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:50.287393 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51f5a297-0ec8-4f52-9f5d-0ff67f8a14d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:50.287726 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-51f5a297-0ec8-4f52-9f5d-0ff67f8a14d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:50.433379 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-51f5a297-0ec8-4f52-9f5d-0ff67f8a14d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:50.442122 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-51f5a297-0ec8-4f52-9f5d-0ff67f8a14d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:50.444448 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-51f5a297-0ec8-4f52-9f5d-0ff67f8a14d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:50.445946 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-51f5a297-0ec8-4f52-9f5d-0ff67f8a14d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1745 microversion: 2.20 time: 0.172718 Jun 23 16:09:50.446740 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 465/909] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:50 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1745 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:51.185310 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3b1f349e-649d-4e5b-a5d2-251b966c9297 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:51.185835 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3b1f349e-649d-4e5b-a5d2-251b966c9297 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:51.192873 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b1f349e-649d-4e5b-a5d2-251b966c9297 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:51.193311 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b1f349e-649d-4e5b-a5d2-251b966c9297 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:51.194062 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b1f349e-649d-4e5b-a5d2-251b966c9297 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:51.194491 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b1f349e-649d-4e5b-a5d2-251b966c9297 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:51.321920 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3b1f349e-649d-4e5b-a5d2-251b966c9297 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:51.330090 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3b1f349e-649d-4e5b-a5d2-251b966c9297 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1362 microversion: 2.1 time: 0.148675 Jun 23 16:09:51.330641 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 445/910] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:51 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:51.464451 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a6d2f673-9c84-46bb-8ca4-4c5daf0a2fa7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:51.465009 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a6d2f673-9c84-46bb-8ca4-4c5daf0a2fa7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:51.471597 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6d2f673-9c84-46bb-8ca4-4c5daf0a2fa7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:51.472046 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6d2f673-9c84-46bb-8ca4-4c5daf0a2fa7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:51.472811 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6d2f673-9c84-46bb-8ca4-4c5daf0a2fa7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:51.473250 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a6d2f673-9c84-46bb-8ca4-4c5daf0a2fa7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:51.600781 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a6d2f673-9c84-46bb-8ca4-4c5daf0a2fa7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:51.609276 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a6d2f673-9c84-46bb-8ca4-4c5daf0a2fa7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:51.610824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a6d2f673-9c84-46bb-8ca4-4c5daf0a2fa7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:51.611986 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a6d2f673-9c84-46bb-8ca4-4c5daf0a2fa7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1745 microversion: 2.20 time: 0.151566 Jun 23 16:09:51.612537 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 466/911] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:51 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:52.118069 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-d119527c-8b25-42a8-b8b8-4d15a5308aab req-6e2dfc1c-c943-478e-9e47-d2f9d411841f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7563514-d6f1-44c1-b8ae-7008e842faf8", "name": "network-vif-plugged", "status": "completed", "tag": "afe54005-6126-4438-ba09-6763f07e66d9"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:52.126633 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-d119527c-8b25-42a8-b8b8-4d15a5308aab req-6e2dfc1c-c943-478e-9e47-d2f9d411841f service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:52.127104 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-d119527c-8b25-42a8-b8b8-4d15a5308aab req-6e2dfc1c-c943-478e-9e47-d2f9d411841f service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:52.139064 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-d119527c-8b25-42a8-b8b8-4d15a5308aab req-6e2dfc1c-c943-478e-9e47-d2f9d411841f service nova] Creating event network-vif-plugged:afe54005-6126-4438-ba09-6763f07e66d9 for instance b7563514-d6f1-44c1-b8ae-7008e842faf8 on hv-cinder-83538 Jun 23 16:09:52.144068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-d119527c-8b25-42a8-b8b8-4d15a5308aab req-6e2dfc1c-c943-478e-9e47-d2f9d411841f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029709 Jun 23 16:09:52.144676 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 446/912] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:52.346786 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7c472116-e898-4360-acc4-80926ba02d32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:52.347402 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7c472116-e898-4360-acc4-80926ba02d32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:52.354967 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c472116-e898-4360-acc4-80926ba02d32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:52.355799 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c472116-e898-4360-acc4-80926ba02d32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:52.356877 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c472116-e898-4360-acc4-80926ba02d32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:52.357685 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7c472116-e898-4360-acc4-80926ba02d32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:52.489931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7c472116-e898-4360-acc4-80926ba02d32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:52.497529 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7c472116-e898-4360-acc4-80926ba02d32 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1362 microversion: 2.1 time: 0.154614 Jun 23 16:09:52.498095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 467/913] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:52 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:52.630667 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f3a68713-628b-436a-a078-4cab06de7406 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:52.631343 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f3a68713-628b-436a-a078-4cab06de7406 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:52.637580 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3a68713-628b-436a-a078-4cab06de7406 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:52.638031 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3a68713-628b-436a-a078-4cab06de7406 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:52.638826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3a68713-628b-436a-a078-4cab06de7406 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:52.639260 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f3a68713-628b-436a-a078-4cab06de7406 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:52.771195 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f3a68713-628b-436a-a078-4cab06de7406 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:52.779407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f3a68713-628b-436a-a078-4cab06de7406 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:52.780907 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f3a68713-628b-436a-a078-4cab06de7406 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:52.782069 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f3a68713-628b-436a-a078-4cab06de7406 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1745 microversion: 2.20 time: 0.156272 Jun 23 16:09:52.782629 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 447/914] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:52 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:53.514013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-33bf21c3-c394-421d-bb5b-75cea9c4ecdd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:53.515304 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-33bf21c3-c394-421d-bb5b-75cea9c4ecdd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:53.521825 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-33bf21c3-c394-421d-bb5b-75cea9c4ecdd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:53.522564 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-33bf21c3-c394-421d-bb5b-75cea9c4ecdd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:53.523357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-33bf21c3-c394-421d-bb5b-75cea9c4ecdd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:53.523805 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-33bf21c3-c394-421d-bb5b-75cea9c4ecdd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:53.654868 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-33bf21c3-c394-421d-bb5b-75cea9c4ecdd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:53.662274 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-33bf21c3-c394-421d-bb5b-75cea9c4ecdd tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1362 microversion: 2.1 time: 0.152125 Jun 23 16:09:53.662864 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 468/915] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:53 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:53.800737 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-5dab9cd8-792e-4016-baaa-8769226bcc17 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:53.801274 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-5dab9cd8-792e-4016-baaa-8769226bcc17 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:53.807747 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5dab9cd8-792e-4016-baaa-8769226bcc17 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:53.808193 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5dab9cd8-792e-4016-baaa-8769226bcc17 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:53.808982 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5dab9cd8-792e-4016-baaa-8769226bcc17 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:53.809378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-5dab9cd8-792e-4016-baaa-8769226bcc17 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:53.965647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5dab9cd8-792e-4016-baaa-8769226bcc17 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:53.974085 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5dab9cd8-792e-4016-baaa-8769226bcc17 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:53.975534 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-5dab9cd8-792e-4016-baaa-8769226bcc17 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:53.976702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-5dab9cd8-792e-4016-baaa-8769226bcc17 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1745 microversion: 2.20 time: 0.179996 Jun 23 16:09:53.977263 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 448/916] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:53 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:54.678990 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b2ec7a2b-8800-41fe-a1b0-0d5ce17de43c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:54.679599 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b2ec7a2b-8800-41fe-a1b0-0d5ce17de43c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:54.686099 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2ec7a2b-8800-41fe-a1b0-0d5ce17de43c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:54.686551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2ec7a2b-8800-41fe-a1b0-0d5ce17de43c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:54.687352 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2ec7a2b-8800-41fe-a1b0-0d5ce17de43c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:54.687823 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b2ec7a2b-8800-41fe-a1b0-0d5ce17de43c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:54.819508 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b2ec7a2b-8800-41fe-a1b0-0d5ce17de43c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:54.827589 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b2ec7a2b-8800-41fe-a1b0-0d5ce17de43c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1362 microversion: 2.1 time: 0.151852 Jun 23 16:09:54.828067 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 469/917] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:54 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:54.994584 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-10be7f57-0bb4-4735-8e6b-323af9837e8e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:54.995232 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-10be7f57-0bb4-4735-8e6b-323af9837e8e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:55.002332 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-10be7f57-0bb4-4735-8e6b-323af9837e8e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:55.003080 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-10be7f57-0bb4-4735-8e6b-323af9837e8e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:55.003555 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-10be7f57-0bb4-4735-8e6b-323af9837e8e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:55.003991 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-10be7f57-0bb4-4735-8e6b-323af9837e8e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:55.023046 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:55.144424 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-10be7f57-0bb4-4735-8e6b-323af9837e8e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:55.153554 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-10be7f57-0bb4-4735-8e6b-323af9837e8e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:55.155081 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-10be7f57-0bb4-4735-8e6b-323af9837e8e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:55.156241 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-10be7f57-0bb4-4735-8e6b-323af9837e8e tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1740 microversion: 2.20 time: 0.165594 Jun 23 16:09:55.156789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 449/918] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:54 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:55.845794 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-a118e10b-3715-4a73-abb2-f80771d5e43f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:55.846471 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-a118e10b-3715-4a73-abb2-f80771d5e43f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:55.854983 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a118e10b-3715-4a73-abb2-f80771d5e43f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:55.855721 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a118e10b-3715-4a73-abb2-f80771d5e43f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:55.856504 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a118e10b-3715-4a73-abb2-f80771d5e43f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:55.857161 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-a118e10b-3715-4a73-abb2-f80771d5e43f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:56.007557 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-a118e10b-3715-4a73-abb2-f80771d5e43f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:56.017132 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-a118e10b-3715-4a73-abb2-f80771d5e43f tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1362 microversion: 2.1 time: 0.176211 Jun 23 16:09:56.027333 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 470/919] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:55 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:56.174889 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e8fcca91-1325-4e56-8339-ccc42fe80f4c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:56.176169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e8fcca91-1325-4e56-8339-ccc42fe80f4c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:56.183235 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e8fcca91-1325-4e56-8339-ccc42fe80f4c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:56.183984 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e8fcca91-1325-4e56-8339-ccc42fe80f4c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:56.184748 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-55b823ec-70ba-478f-a778-aac739261c56 req-a7ef2cdf-30ef-43a3-950d-9f06b9348d80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81c71b24-1c7c-409e-acac-c6946af2692c", "name": "network-vif-plugged", "status": "completed", "tag": "09f5835c-4231-4c60-92b4-d34edd7b9267"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:09:56.185112 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e8fcca91-1325-4e56-8339-ccc42fe80f4c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:56.185240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e8fcca91-1325-4e56-8339-ccc42fe80f4c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:56.198644 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-55b823ec-70ba-478f-a778-aac739261c56 req-a7ef2cdf-30ef-43a3-950d-9f06b9348d80 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:56.199139 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-55b823ec-70ba-478f-a778-aac739261c56 req-a7ef2cdf-30ef-43a3-950d-9f06b9348d80 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:56.212788 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=100 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:56.223596 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-55b823ec-70ba-478f-a778-aac739261c56 req-a7ef2cdf-30ef-43a3-950d-9f06b9348d80 service nova] Creating event network-vif-plugged:09f5835c-4231-4c60-92b4-d34edd7b9267 for instance 81c71b24-1c7c-409e-acac-c6946af2692c on hv-cinder-83538 Jun 23 16:09:56.230068 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-55b823ec-70ba-478f-a778-aac739261c56 req-a7ef2cdf-30ef-43a3-950d-9f06b9348d80 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048954 Jun 23 16:09:56.231294 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 471/920] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:56.367462 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e8fcca91-1325-4e56-8339-ccc42fe80f4c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:56.376447 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e8fcca91-1325-4e56-8339-ccc42fe80f4c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:56.378000 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e8fcca91-1325-4e56-8339-ccc42fe80f4c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:56.379492 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e8fcca91-1325-4e56-8339-ccc42fe80f4c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1740 microversion: 2.20 time: 0.208881 Jun 23 16:09:56.391075 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 450/921] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:56 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:57.037869 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-bd1bf144-00a0-4d91-b176-e70b818af780 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:57.039510 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-bd1bf144-00a0-4d91-b176-e70b818af780 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:57.048168 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd1bf144-00a0-4d91-b176-e70b818af780 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:57.048624 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd1bf144-00a0-4d91-b176-e70b818af780 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:57.049899 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd1bf144-00a0-4d91-b176-e70b818af780 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:57.050954 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-bd1bf144-00a0-4d91-b176-e70b818af780 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:57.212067 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-bd1bf144-00a0-4d91-b176-e70b818af780 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:57.220138 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-bd1bf144-00a0-4d91-b176-e70b818af780 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1362 microversion: 2.1 time: 0.189194 Jun 23 16:09:57.220701 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 472/922] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:57 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:09:57.398535 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cc807274-975f-451f-8ded-49aac3acfe86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:57.399163 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cc807274-975f-451f-8ded-49aac3acfe86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:57.406170 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc807274-975f-451f-8ded-49aac3acfe86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:57.406617 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc807274-975f-451f-8ded-49aac3acfe86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:57.407405 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc807274-975f-451f-8ded-49aac3acfe86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:57.407844 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc807274-975f-451f-8ded-49aac3acfe86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:57.554091 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cc807274-975f-451f-8ded-49aac3acfe86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:57.562565 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cc807274-975f-451f-8ded-49aac3acfe86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:57.564106 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cc807274-975f-451f-8ded-49aac3acfe86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:57.565378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cc807274-975f-451f-8ded-49aac3acfe86 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1740 microversion: 2.20 time: 0.170923 Jun 23 16:09:57.565939 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 451/923] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:57 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:58.236967 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-fbe19e34-03ed-4754-b5f1-0b57ac3aef1d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:58.237505 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-fbe19e34-03ed-4754-b5f1-0b57ac3aef1d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:58.239434 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:58.240086 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=6 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:58.246375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbe19e34-03ed-4754-b5f1-0b57ac3aef1d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:58.246848 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbe19e34-03ed-4754-b5f1-0b57ac3aef1d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:58.247621 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbe19e34-03ed-4754-b5f1-0b57ac3aef1d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:58.248055 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-fbe19e34-03ed-4754-b5f1-0b57ac3aef1d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:58.400990 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-fbe19e34-03ed-4754-b5f1-0b57ac3aef1d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:58.408507 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-fbe19e34-03ed-4754-b5f1-0b57ac3aef1d tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1548 microversion: 2.1 time: 0.175475 Jun 23 16:09:58.409064 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 473/924] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:09:58 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:09:58.425169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-699c42e8-3031-475b-ab63-8d59c420b0d4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:58.425928 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-699c42e8-3031-475b-ab63-8d59c420b0d4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:58.428084 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:09:58.434847 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-699c42e8-3031-475b-ab63-8d59c420b0d4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:58.435379 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-699c42e8-3031-475b-ab63-8d59c420b0d4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:58.436905 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-699c42e8-3031-475b-ab63-8d59c420b0d4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:58.437402 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-699c42e8-3031-475b-ab63-8d59c420b0d4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:58.544505 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-699c42e8-3031-475b-ab63-8d59c420b0d4 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.123256 Jun 23 16:09:58.545358 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 452/925] 10.222.0.46 () {58 vars in 1274 bytes} [Thu Jun 23 16:09:58 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:09:58.585674 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6060ef48-eea6-46bc-9989-eacff42ba428 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:58.586626 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6060ef48-eea6-46bc-9989-eacff42ba428 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:58.592908 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6060ef48-eea6-46bc-9989-eacff42ba428 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:58.593660 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6060ef48-eea6-46bc-9989-eacff42ba428 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:58.594860 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6060ef48-eea6-46bc-9989-eacff42ba428 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:58.595305 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6060ef48-eea6-46bc-9989-eacff42ba428 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:58.735384 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6060ef48-eea6-46bc-9989-eacff42ba428 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:58.745524 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6060ef48-eea6-46bc-9989-eacff42ba428 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:58.748026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6060ef48-eea6-46bc-9989-eacff42ba428 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:09:58.749710 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6060ef48-eea6-46bc-9989-eacff42ba428 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1740 microversion: 2.20 time: 0.168512 Jun 23 16:09:58.750510 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 474/926] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:58 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:09:59.771396 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-375361f9-bfd1-4123-a481-6dc5e8ce8aa6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:09:59.773780 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-375361f9-bfd1-4123-a481-6dc5e8ce8aa6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:09:59.780192 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-375361f9-bfd1-4123-a481-6dc5e8ce8aa6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:59.781580 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-375361f9-bfd1-4123-a481-6dc5e8ce8aa6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:09:59.782595 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-375361f9-bfd1-4123-a481-6dc5e8ce8aa6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:09:59.783271 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-375361f9-bfd1-4123-a481-6dc5e8ce8aa6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:00.012159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-375361f9-bfd1-4123-a481-6dc5e8ce8aa6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:00.022406 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-375361f9-bfd1-4123-a481-6dc5e8ce8aa6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:00.024259 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-375361f9-bfd1-4123-a481-6dc5e8ce8aa6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:00.025739 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-375361f9-bfd1-4123-a481-6dc5e8ce8aa6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1740 microversion: 2.20 time: 0.259263 Jun 23 16:10:00.036927 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 453/927] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:09:59 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:00.153083 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-dddf88c4-352b-4858-ba05-d561e267d8a6 req-1537bd40-1d20-4de9-a50b-6e4e519813a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81c71b24-1c7c-409e-acac-c6946af2692c", "tag": "09f5835c-4231-4c60-92b4-d34edd7b9267"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:10:00.173394 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-dddf88c4-352b-4858-ba05-d561e267d8a6 req-1537bd40-1d20-4de9-a50b-6e4e519813a4 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:00.173847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-dddf88c4-352b-4858-ba05-d561e267d8a6 req-1537bd40-1d20-4de9-a50b-6e4e519813a4 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:00.190107 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-dddf88c4-352b-4858-ba05-d561e267d8a6 req-1537bd40-1d20-4de9-a50b-6e4e519813a4 service nova] Creating event network-changed:09f5835c-4231-4c60-92b4-d34edd7b9267 for instance 81c71b24-1c7c-409e-acac-c6946af2692c on hv-cinder-83538 Jun 23 16:10:00.196523 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-dddf88c4-352b-4858-ba05-d561e267d8a6 req-1537bd40-1d20-4de9-a50b-6e4e519813a4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047194 Jun 23 16:10:00.197598 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 475/928] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:10:01.046299 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cf0e0059-d7b5-4525-bcaf-5a37f3aa71c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:01.047550 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cf0e0059-d7b5-4525-bcaf-5a37f3aa71c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:01.055153 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf0e0059-d7b5-4525-bcaf-5a37f3aa71c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:01.055895 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf0e0059-d7b5-4525-bcaf-5a37f3aa71c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:01.056832 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf0e0059-d7b5-4525-bcaf-5a37f3aa71c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:01.057427 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cf0e0059-d7b5-4525-bcaf-5a37f3aa71c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:01.245032 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cf0e0059-d7b5-4525-bcaf-5a37f3aa71c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:01.257736 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cf0e0059-d7b5-4525-bcaf-5a37f3aa71c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:01.259938 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cf0e0059-d7b5-4525-bcaf-5a37f3aa71c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:01.261442 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cf0e0059-d7b5-4525-bcaf-5a37f3aa71c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1740 microversion: 2.20 time: 0.220507 Jun 23 16:10:01.273912 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 454/929] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:01 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1740 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:02.281574 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9a85eb9d-4d37-48e8-ac8b-e7e66afc0f07 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:02.282286 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9a85eb9d-4d37-48e8-ac8b-e7e66afc0f07 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:02.288964 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a85eb9d-4d37-48e8-ac8b-e7e66afc0f07 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:02.289407 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a85eb9d-4d37-48e8-ac8b-e7e66afc0f07 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:02.290167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a85eb9d-4d37-48e8-ac8b-e7e66afc0f07 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:02.290597 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9a85eb9d-4d37-48e8-ac8b-e7e66afc0f07 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:02.449049 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9a85eb9d-4d37-48e8-ac8b-e7e66afc0f07 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:02.458442 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9a85eb9d-4d37-48e8-ac8b-e7e66afc0f07 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:02.460053 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9a85eb9d-4d37-48e8-ac8b-e7e66afc0f07 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:02.461284 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9a85eb9d-4d37-48e8-ac8b-e7e66afc0f07 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1740 microversion: 2.20 time: 0.184660 Jun 23 16:10:02.461932 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 476/930] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:02 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:03.482540 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-7d91aa93-e8d1-4ed2-a2aa-66c43a2b7a79 req-520535be-46e1-4cf5-83bf-316a4d49b54e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3d20925-62c2-42d3-9cd4-87cafcfcb78c", "tag": "a2b7418c-7a16-44c2-9376-785b79ce1926"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:10:03.484463 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-43e2ae6f-7e94-44e7-bcac-4c409cfcf459 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:03.484981 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-43e2ae6f-7e94-44e7-bcac-4c409cfcf459 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:03.497684 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-43e2ae6f-7e94-44e7-bcac-4c409cfcf459 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:03.499022 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-43e2ae6f-7e94-44e7-bcac-4c409cfcf459 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:03.499974 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-43e2ae6f-7e94-44e7-bcac-4c409cfcf459 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:03.500598 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-43e2ae6f-7e94-44e7-bcac-4c409cfcf459 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:03.508005 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7d91aa93-e8d1-4ed2-a2aa-66c43a2b7a79 req-520535be-46e1-4cf5-83bf-316a4d49b54e service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:03.515588 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-7d91aa93-e8d1-4ed2-a2aa-66c43a2b7a79 req-520535be-46e1-4cf5-83bf-316a4d49b54e service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:03.535493 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-7d91aa93-e8d1-4ed2-a2aa-66c43a2b7a79 req-520535be-46e1-4cf5-83bf-316a4d49b54e service nova] Creating event network-changed:a2b7418c-7a16-44c2-9376-785b79ce1926 for instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c on hv-cinder-83538 Jun 23 16:10:03.547989 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-7d91aa93-e8d1-4ed2-a2aa-66c43a2b7a79 req-520535be-46e1-4cf5-83bf-316a4d49b54e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068104 Jun 23 16:10:03.547989 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 477/931] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:10:03.562744 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-43e2ae6f-7e94-44e7-bcac-4c409cfcf459 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:10:03.571569 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7ff69993-6a00-46fe-9b71-5c8596366b4d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:03.572277 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7ff69993-6a00-46fe-9b71-5c8596366b4d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:03.590919 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7ff69993-6a00-46fe-9b71-5c8596366b4d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:03.591630 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7ff69993-6a00-46fe-9b71-5c8596366b4d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:03.593333 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7ff69993-6a00-46fe-9b71-5c8596366b4d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:03.595259 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7ff69993-6a00-46fe-9b71-5c8596366b4d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:03.753443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-43e2ae6f-7e94-44e7-bcac-4c409cfcf459 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 204 len: 0 microversion: 2.1 time: 0.275696 Jun 23 16:10:03.754193 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 455/932] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:10:03 2022] DELETE /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 16:10:03.782999 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4e89eac0-8092-464e-a106-e5783f473cea tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:03.790001 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4e89eac0-8092-464e-a106-e5783f473cea tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:03.807709 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e89eac0-8092-464e-a106-e5783f473cea tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:03.813687 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7ff69993-6a00-46fe-9b71-5c8596366b4d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:03.814137 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e89eac0-8092-464e-a106-e5783f473cea tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:03.817932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e89eac0-8092-464e-a106-e5783f473cea tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:03.820676 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e89eac0-8092-464e-a106-e5783f473cea tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:03.824552 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7ff69993-6a00-46fe-9b71-5c8596366b4d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:03.826498 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7ff69993-6a00-46fe-9b71-5c8596366b4d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:03.829250 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7ff69993-6a00-46fe-9b71-5c8596366b4d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1740 microversion: 2.20 time: 0.280317 Jun 23 16:10:03.830022 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 478/933] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:03 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:04.017000 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-4e89eac0-8092-464e-a106-e5783f473cea tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:04.025938 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4e89eac0-8092-464e-a106-e5783f473cea tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.265024 Jun 23 16:10:04.038628 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 456/934] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:10:03 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:10:04.849712 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-6fd150d1-426d-4b2a-a165-220ce7d5e4b3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:04.850451 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-6fd150d1-426d-4b2a-a165-220ce7d5e4b3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:04.858059 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6fd150d1-426d-4b2a-a165-220ce7d5e4b3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:04.858530 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6fd150d1-426d-4b2a-a165-220ce7d5e4b3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:04.859325 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6fd150d1-426d-4b2a-a165-220ce7d5e4b3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:04.859755 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-6fd150d1-426d-4b2a-a165-220ce7d5e4b3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:05.009446 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6fd150d1-426d-4b2a-a165-220ce7d5e4b3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:05.019182 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6fd150d1-426d-4b2a-a165-220ce7d5e4b3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:05.020843 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-6fd150d1-426d-4b2a-a165-220ce7d5e4b3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:05.022385 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-6fd150d1-426d-4b2a-a165-220ce7d5e4b3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1740 microversion: 2.20 time: 0.178216 Jun 23 16:10:05.023768 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 479/935] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:04 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:05.047504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d7bce74b-5788-489a-b2a8-db76325be745 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:05.048785 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d7bce74b-5788-489a-b2a8-db76325be745 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:05.058323 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d7bce74b-5788-489a-b2a8-db76325be745 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:05.059174 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d7bce74b-5788-489a-b2a8-db76325be745 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:05.060409 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d7bce74b-5788-489a-b2a8-db76325be745 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:05.061815 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d7bce74b-5788-489a-b2a8-db76325be745 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:05.322724 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d7bce74b-5788-489a-b2a8-db76325be745 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:05.331556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d7bce74b-5788-489a-b2a8-db76325be745 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1567 microversion: 2.1 time: 0.289212 Jun 23 16:10:05.332154 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 457/936] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:10:05 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1567 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:10:06.041637 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-02049121-4e4e-41ca-bc7d-430ec26b7ed4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:06.042246 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-02049121-4e4e-41ca-bc7d-430ec26b7ed4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:06.049141 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-02049121-4e4e-41ca-bc7d-430ec26b7ed4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:06.049853 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-02049121-4e4e-41ca-bc7d-430ec26b7ed4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:06.050824 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-02049121-4e4e-41ca-bc7d-430ec26b7ed4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:06.051797 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-02049121-4e4e-41ca-bc7d-430ec26b7ed4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:06.226994 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-02049121-4e4e-41ca-bc7d-430ec26b7ed4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:06.235813 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-02049121-4e4e-41ca-bc7d-430ec26b7ed4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:06.237546 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-02049121-4e4e-41ca-bc7d-430ec26b7ed4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:06.239252 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-02049121-4e4e-41ca-bc7d-430ec26b7ed4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1740 microversion: 2.20 time: 0.202023 Jun 23 16:10:06.250279 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 480/937] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:06 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:06.348806 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8a2cc3ea-3ed7-450b-8dab-d2406bc70530 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:06.349410 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8a2cc3ea-3ed7-450b-8dab-d2406bc70530 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:06.355949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8a2cc3ea-3ed7-450b-8dab-d2406bc70530 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:06.356389 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8a2cc3ea-3ed7-450b-8dab-d2406bc70530 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:06.357175 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8a2cc3ea-3ed7-450b-8dab-d2406bc70530 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:06.357636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8a2cc3ea-3ed7-450b-8dab-d2406bc70530 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:06.572488 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-353f66bc-3d21-40db-a4f9-5f9256397f5a req-230f56e6-a61b-4415-a5b0-7638379381df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3d20925-62c2-42d3-9cd4-87cafcfcb78c", "name": "network-vif-deleted", "tag": "a2b7418c-7a16-44c2-9376-785b79ce1926"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:10:06.580575 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-353f66bc-3d21-40db-a4f9-5f9256397f5a req-230f56e6-a61b-4415-a5b0-7638379381df service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:06.581328 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-353f66bc-3d21-40db-a4f9-5f9256397f5a req-230f56e6-a61b-4415-a5b0-7638379381df service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:06.592851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8a2cc3ea-3ed7-450b-8dab-d2406bc70530 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:06.593977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-353f66bc-3d21-40db-a4f9-5f9256397f5a req-230f56e6-a61b-4415-a5b0-7638379381df service nova] Creating event network-vif-deleted:a2b7418c-7a16-44c2-9376-785b79ce1926 for instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c on hv-cinder-83538 Jun 23 16:10:06.598974 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-353f66bc-3d21-40db-a4f9-5f9256397f5a req-230f56e6-a61b-4415-a5b0-7638379381df service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031451 Jun 23 16:10:06.599705 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 481/938] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:10:06.603576 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8a2cc3ea-3ed7-450b-8dab-d2406bc70530 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1448 microversion: 2.1 time: 0.258805 Jun 23 16:10:06.604188 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 458/939] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:10:06 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1448 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:10:07.258626 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-2d592678-804c-47b6-9cd4-37267a347952 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:07.259631 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-2d592678-804c-47b6-9cd4-37267a347952 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:07.266793 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2d592678-804c-47b6-9cd4-37267a347952 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:07.267303 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2d592678-804c-47b6-9cd4-37267a347952 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:07.268078 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2d592678-804c-47b6-9cd4-37267a347952 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:07.268661 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-2d592678-804c-47b6-9cd4-37267a347952 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:07.399725 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2d592678-804c-47b6-9cd4-37267a347952 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:07.408322 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2d592678-804c-47b6-9cd4-37267a347952 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:07.409839 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-2d592678-804c-47b6-9cd4-37267a347952 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:07.411027 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-2d592678-804c-47b6-9cd4-37267a347952 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1722 microversion: 2.20 time: 0.157190 Jun 23 16:10:07.411600 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 482/940] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:07 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:07.621916 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:07.622588 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:07.630131 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:07.630580 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:07.631394 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:07.631833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:07.667847 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:07.668416 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:07.668751 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lazy-loading 'fault' on Instance uuid e3d20925-62c2-42d3-9cd4-87cafcfcb78c {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:10:07.739871 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2399b4fc64f74475bd8dc7b1634a2c2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbde90b595244aef82fd4d52d4abfaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:07.746811 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-33bfdc66-a89e-4adc-93b0-877d6f8f46e6 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 200 len: 1177 microversion: 2.1 time: 0.129317 Jun 23 16:10:07.747397 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 459/941] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:10:07 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 1177 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:10:08.212694 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-8cc8df72-9015-4085-96f5-84bfd1f5954e req-c5164873-0a5d-4764-b18e-35d9e922127a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7563514-d6f1-44c1-b8ae-7008e842faf8", "name": "network-vif-unplugged", "status": "completed", "tag": "afe54005-6126-4438-ba09-6763f07e66d9"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:10:08.221817 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-8cc8df72-9015-4085-96f5-84bfd1f5954e req-c5164873-0a5d-4764-b18e-35d9e922127a service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:08.222569 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-8cc8df72-9015-4085-96f5-84bfd1f5954e req-c5164873-0a5d-4764-b18e-35d9e922127a service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:08.234095 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-8cc8df72-9015-4085-96f5-84bfd1f5954e req-c5164873-0a5d-4764-b18e-35d9e922127a service nova] Creating event network-vif-unplugged:afe54005-6126-4438-ba09-6763f07e66d9 for instance b7563514-d6f1-44c1-b8ae-7008e842faf8 on hv-cinder-83538 Jun 23 16:10:08.239226 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-8cc8df72-9015-4085-96f5-84bfd1f5954e req-c5164873-0a5d-4764-b18e-35d9e922127a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030372 Jun 23 16:10:08.239817 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 483/942] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:10:08.429434 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-084cd227-aafa-486b-9bdf-d323b3b2919f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:08.429971 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-084cd227-aafa-486b-9bdf-d323b3b2919f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:08.436293 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-084cd227-aafa-486b-9bdf-d323b3b2919f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:08.436744 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-084cd227-aafa-486b-9bdf-d323b3b2919f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:08.437509 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-084cd227-aafa-486b-9bdf-d323b3b2919f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:08.437944 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-084cd227-aafa-486b-9bdf-d323b3b2919f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:08.568858 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-084cd227-aafa-486b-9bdf-d323b3b2919f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:08.577127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-084cd227-aafa-486b-9bdf-d323b3b2919f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:08.578668 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-084cd227-aafa-486b-9bdf-d323b3b2919f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:08.579852 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-084cd227-aafa-486b-9bdf-d323b3b2919f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1722 microversion: 2.20 time: 0.154401 Jun 23 16:10:08.580411 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 460/943] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:08 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:08.766262 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1fcef7d7-9370-401b-9f52-e6e8c97d36c1 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:08.766937 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1fcef7d7-9370-401b-9f52-e6e8c97d36c1 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] [instance: e3d20925-62c2-42d3-9cd4-87cafcfcb78c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:08.773376 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1fcef7d7-9370-401b-9f52-e6e8c97d36c1 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:08.773817 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1fcef7d7-9370-401b-9f52-e6e8c97d36c1 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:08.774565 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1fcef7d7-9370-401b-9f52-e6e8c97d36c1 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:08.775029 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1fcef7d7-9370-401b-9f52-e6e8c97d36c1 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:08.788814 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-1fcef7d7-9370-401b-9f52-e6e8c97d36c1 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] HTTP exception thrown: Instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c could not be found. Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1fcef7d7-9370-401b-9f52-e6e8c97d36c1 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Request method failure captured: Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c HTTP/1.1 Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI642xV5JYjVwPnxE07UyZn-jBxnDazqKpN8Kuo3YVTVn2TL9Mfv5aYR6QwRGs8xXwptVGsHPSTyx7LWXAzXuqNQEg8EixnIlPRKPLJFt_dKIRVKFj2FA8Lp7BKliYTVV_cM5dBYLp8Ih5qAkA-lwgpwOML8zuf2MVxPwcMoTTWMwB4 Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: bbde90b595244aef82fd4d52d4abfaa8 Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-TestShelveInstance-1302695656 Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:10:08.790478 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbde90b595244aef82fd4d52d4abfaa8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/bbde90b595244aef82fd4d52d4abfaa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/bbde90b595244aef82fd4d52d4abfaa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_bbde90b595244aef82fd4d52d4abfaa8"}]}] Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-TestShelveInstance-1302695656 Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: bbde90b595244aef82fd4d52d4abfaa8 Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-TestShelveInstance-1302695656 Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-TestShelveInstance-1302695656-project Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: 2399b4fc64f74475bd8dc7b1634a2c2a Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-TestShelveInstance-1302695656-project Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c could not be found. Jun 23 16:10:08.792090 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': 'e3d20925-62c2-42d3-9cd4-87cafcfcb78c'} Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c could not be found. Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:10:08.793191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c could not be found. Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c could not be found. Jun 23 16:10:08.794728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:10:08.796249 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1fcef7d7-9370-401b-9f52-e6e8c97d36c1 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Returning 404 to user: Instance e3d20925-62c2-42d3-9cd4-87cafcfcb78c could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:10:08.796249 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1fcef7d7-9370-401b-9f52-e6e8c97d36c1 tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c" status: 404 len: 111 microversion: 2.1 time: 0.031052 Jun 23 16:10:08.796249 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 484/944] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:10:08 2022] GET /compute/v2.1/servers/e3d20925-62c2-42d3-9cd4-87cafcfcb78c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:10:08.950564 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-db3d6cc7-bfa7-4f0a-8373-d72d771a324e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] Calling method '.version_select at 0x7fe28d418af0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:08.973441 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-db3d6cc7-bfa7-4f0a-8373-d72d771a324e tempest-TestShelveInstance-1302695656 tempest-TestShelveInstance-1302695656-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-483265151" status: 202 len: 0 microversion: 2.1 time: 0.026316 Jun 23 16:10:08.974198 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 461/945] 10.222.0.46 () {58 vars in 1250 bytes} [Thu Jun 23 16:10:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-483265151 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:10:09.605465 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-feb21d16-4f25-4c40-aa4d-48d979e4f31c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:09.606204 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-feb21d16-4f25-4c40-aa4d-48d979e4f31c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:09.612843 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-feb21d16-4f25-4c40-aa4d-48d979e4f31c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:09.613362 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-feb21d16-4f25-4c40-aa4d-48d979e4f31c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:09.614200 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-feb21d16-4f25-4c40-aa4d-48d979e4f31c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:09.614768 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-feb21d16-4f25-4c40-aa4d-48d979e4f31c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:09.834381 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-feb21d16-4f25-4c40-aa4d-48d979e4f31c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:09.842956 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-feb21d16-4f25-4c40-aa4d-48d979e4f31c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:09.844488 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-feb21d16-4f25-4c40-aa4d-48d979e4f31c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:09.845664 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-feb21d16-4f25-4c40-aa4d-48d979e4f31c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1722 microversion: 2.20 time: 0.244224 Jun 23 16:10:09.846211 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 485/946] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:09 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:10.864023 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-556d15fb-586e-4595-aae3-59b48bd568d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:10.864638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-556d15fb-586e-4595-aae3-59b48bd568d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:10.871809 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-556d15fb-586e-4595-aae3-59b48bd568d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:10.872293 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-556d15fb-586e-4595-aae3-59b48bd568d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:10.873791 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-556d15fb-586e-4595-aae3-59b48bd568d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:10.874392 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-556d15fb-586e-4595-aae3-59b48bd568d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:11.009534 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-556d15fb-586e-4595-aae3-59b48bd568d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:11.019254 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-556d15fb-586e-4595-aae3-59b48bd568d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:11.021101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-556d15fb-586e-4595-aae3-59b48bd568d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:11.022544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-556d15fb-586e-4595-aae3-59b48bd568d4 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1665 microversion: 2.20 time: 0.162559 Jun 23 16:10:11.026731 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 462/947] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:10 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:11.041408 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d445a065-4005-4942-aeb0-f0e17b6a4d6b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87e40fbf-d10e-4070-8b73-5c7005a5b118"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:10:11.042680 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d445a065-4005-4942-aeb0-f0e17b6a4d6b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:11.050485 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d445a065-4005-4942-aeb0-f0e17b6a4d6b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:11.050961 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d445a065-4005-4942-aeb0-f0e17b6a4d6b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:11.051725 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d445a065-4005-4942-aeb0-f0e17b6a4d6b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:11.052150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d445a065-4005-4942-aeb0-f0e17b6a4d6b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:11.344657 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d445a065-4005-4942-aeb0-f0e17b6a4d6b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "POST /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.307046 Jun 23 16:10:11.351152 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 486/948] 10.222.0.46 () {62 vars in 1363 bytes} [Thu Jun 23 16:10:11 2022] POST /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/os-volume_attachments => generated 188 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 16:10:11.474916 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-646db464-6d5c-41f9-9826-405526eced3b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:11.475672 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-646db464-6d5c-41f9-9826-405526eced3b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:11.482611 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-646db464-6d5c-41f9-9826-405526eced3b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:11.483893 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-646db464-6d5c-41f9-9826-405526eced3b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:11.484683 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-646db464-6d5c-41f9-9826-405526eced3b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:11.485113 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-646db464-6d5c-41f9-9826-405526eced3b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:11.743459 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:10:11.772529 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-646db464-6d5c-41f9-9826-405526eced3b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/os-volume_attachments/87e40fbf-d10e-4070-8b73-5c7005a5b118" status: 202 len: 0 microversion: 2.20 time: 0.301289 Jun 23 16:10:11.773247 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 463/949] 10.222.0.46 () {60 vars in 1456 bytes} [Thu Jun 23 16:10:11 2022] DELETE /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/os-volume_attachments/87e40fbf-d10e-4070-8b73-5c7005a5b118 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:10:11.837828 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-cada6ce3-7ca7-4c91-9bfa-9c13271a415a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:10:11.838495 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-cada6ce3-7ca7-4c91-9bfa-9c13271a415a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:11.846222 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cada6ce3-7ca7-4c91-9bfa-9c13271a415a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:11.846781 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cada6ce3-7ca7-4c91-9bfa-9c13271a415a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:11.847707 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cada6ce3-7ca7-4c91-9bfa-9c13271a415a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:11.848127 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-cada6ce3-7ca7-4c91-9bfa-9c13271a415a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:12.024388 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-cada6ce3-7ca7-4c91-9bfa-9c13271a415a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "POST /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/action" status: 202 len: 0 microversion: 2.20 time: 0.195458 Jun 23 16:10:12.025657 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 487/950] 10.222.0.46 () {62 vars in 1318 bytes} [Thu Jun 23 16:10:11 2022] POST /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:10:12.034164 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-61114b51-63a6-4859-a369-61a55d6896ee tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:12.034878 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-61114b51-63a6-4859-a369-61a55d6896ee tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:12.042807 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61114b51-63a6-4859-a369-61a55d6896ee tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:12.043242 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61114b51-63a6-4859-a369-61a55d6896ee tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:12.044071 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61114b51-63a6-4859-a369-61a55d6896ee tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:12.044646 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-61114b51-63a6-4859-a369-61a55d6896ee tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:12.235430 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-61114b51-63a6-4859-a369-61a55d6896ee tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:12.246105 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-61114b51-63a6-4859-a369-61a55d6896ee tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:12.247660 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-61114b51-63a6-4859-a369-61a55d6896ee tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:12.254982 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-61114b51-63a6-4859-a369-61a55d6896ee tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1673 microversion: 2.20 time: 0.222041 Jun 23 16:10:12.254982 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 464/951] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:12 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1673 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:10:13.270598 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4e9bf025-b4d3-47d8-8b54-d4acc260b647 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:13.271153 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4e9bf025-b4d3-47d8-8b54-d4acc260b647 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:13.273463 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:10:13.280860 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4e9bf025-b4d3-47d8-8b54-d4acc260b647 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:13.281311 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4e9bf025-b4d3-47d8-8b54-d4acc260b647 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:13.282070 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4e9bf025-b4d3-47d8-8b54-d4acc260b647 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:13.282504 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4e9bf025-b4d3-47d8-8b54-d4acc260b647 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:13.287603 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:10:13.419912 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4e9bf025-b4d3-47d8-8b54-d4acc260b647 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:13.428124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4e9bf025-b4d3-47d8-8b54-d4acc260b647 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:13.429728 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4e9bf025-b4d3-47d8-8b54-d4acc260b647 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:13.430923 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4e9bf025-b4d3-47d8-8b54-d4acc260b647 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.164870 Jun 23 16:10:13.431489 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 488/952] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:13 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:14.449625 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f24a2ab0-3d0f-4749-8ae7-1e8d46d8107a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:14.450126 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f24a2ab0-3d0f-4749-8ae7-1e8d46d8107a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:14.452754 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:10:14.458638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f24a2ab0-3d0f-4749-8ae7-1e8d46d8107a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:14.458638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f24a2ab0-3d0f-4749-8ae7-1e8d46d8107a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:14.459307 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f24a2ab0-3d0f-4749-8ae7-1e8d46d8107a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:14.460117 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f24a2ab0-3d0f-4749-8ae7-1e8d46d8107a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:14.697544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f24a2ab0-3d0f-4749-8ae7-1e8d46d8107a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:14.707667 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f24a2ab0-3d0f-4749-8ae7-1e8d46d8107a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:14.709185 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f24a2ab0-3d0f-4749-8ae7-1e8d46d8107a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:14.710358 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f24a2ab0-3d0f-4749-8ae7-1e8d46d8107a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.264926 Jun 23 16:10:14.711305 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 465/953] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:14 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:15.729247 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-25994997-05b6-4b88-ba99-3bafd772feba tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:15.729861 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-25994997-05b6-4b88-ba99-3bafd772feba tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:15.737191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-25994997-05b6-4b88-ba99-3bafd772feba tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:15.737639 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-25994997-05b6-4b88-ba99-3bafd772feba tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:15.738410 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-25994997-05b6-4b88-ba99-3bafd772feba tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:15.738891 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-25994997-05b6-4b88-ba99-3bafd772feba tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:15.917155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-25994997-05b6-4b88-ba99-3bafd772feba tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:15.937593 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-25994997-05b6-4b88-ba99-3bafd772feba tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:15.941056 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-25994997-05b6-4b88-ba99-3bafd772feba tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:15.943317 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-25994997-05b6-4b88-ba99-3bafd772feba tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.217816 Jun 23 16:10:15.946758 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 489/954] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:15 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:16.963029 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-03867017-36b0-4132-800b-b656a7705736 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:16.966116 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-03867017-36b0-4132-800b-b656a7705736 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:16.974712 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03867017-36b0-4132-800b-b656a7705736 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:16.976045 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03867017-36b0-4132-800b-b656a7705736 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:16.977251 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03867017-36b0-4132-800b-b656a7705736 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:16.978139 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-03867017-36b0-4132-800b-b656a7705736 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:17.312290 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-03867017-36b0-4132-800b-b656a7705736 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:17.324867 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-03867017-36b0-4132-800b-b656a7705736 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:17.327856 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-03867017-36b0-4132-800b-b656a7705736 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:17.329438 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-03867017-36b0-4132-800b-b656a7705736 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.371457 Jun 23 16:10:17.330950 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 466/955] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:16 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:18.359180 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-50452112-4a64-49fe-8691-df3650476252 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:18.359908 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-50452112-4a64-49fe-8691-df3650476252 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:18.367181 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-50452112-4a64-49fe-8691-df3650476252 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:18.367595 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-50452112-4a64-49fe-8691-df3650476252 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:18.368452 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-50452112-4a64-49fe-8691-df3650476252 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:18.368971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-50452112-4a64-49fe-8691-df3650476252 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:18.558514 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-50452112-4a64-49fe-8691-df3650476252 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:18.574157 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-50452112-4a64-49fe-8691-df3650476252 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:18.580733 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-50452112-4a64-49fe-8691-df3650476252 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:18.583734 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-50452112-4a64-49fe-8691-df3650476252 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.229807 Jun 23 16:10:18.585091 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 490/956] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:18 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:19.603499 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-acec308e-182c-4d62-95bd-3b3ebca92d92 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:19.604109 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-acec308e-182c-4d62-95bd-3b3ebca92d92 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:19.611210 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-acec308e-182c-4d62-95bd-3b3ebca92d92 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:19.611658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-acec308e-182c-4d62-95bd-3b3ebca92d92 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:19.612419 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-acec308e-182c-4d62-95bd-3b3ebca92d92 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:19.612853 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-acec308e-182c-4d62-95bd-3b3ebca92d92 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:19.756251 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-acec308e-182c-4d62-95bd-3b3ebca92d92 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:19.764267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-acec308e-182c-4d62-95bd-3b3ebca92d92 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:19.765763 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-acec308e-182c-4d62-95bd-3b3ebca92d92 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:19.766953 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-acec308e-182c-4d62-95bd-3b3ebca92d92 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.167390 Jun 23 16:10:19.767511 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 467/957] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:19 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:20.785689 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-17fbbec2-bb21-4e66-a30e-b2784abedd57 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:20.786427 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-17fbbec2-bb21-4e66-a30e-b2784abedd57 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:20.793172 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17fbbec2-bb21-4e66-a30e-b2784abedd57 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:20.793621 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17fbbec2-bb21-4e66-a30e-b2784abedd57 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:20.794401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17fbbec2-bb21-4e66-a30e-b2784abedd57 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:20.795412 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-17fbbec2-bb21-4e66-a30e-b2784abedd57 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:20.937008 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-17fbbec2-bb21-4e66-a30e-b2784abedd57 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:20.946312 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-17fbbec2-bb21-4e66-a30e-b2784abedd57 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:20.948011 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-17fbbec2-bb21-4e66-a30e-b2784abedd57 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:20.949300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-17fbbec2-bb21-4e66-a30e-b2784abedd57 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.167753 Jun 23 16:10:20.950266 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 491/958] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:20 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 16:10:21.967870 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-f7f9b582-f68a-43af-9787-052cdfee2d6c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:21.968850 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-f7f9b582-f68a-43af-9787-052cdfee2d6c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:21.976468 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f7f9b582-f68a-43af-9787-052cdfee2d6c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:21.977012 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f7f9b582-f68a-43af-9787-052cdfee2d6c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:21.977867 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f7f9b582-f68a-43af-9787-052cdfee2d6c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:21.978372 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-f7f9b582-f68a-43af-9787-052cdfee2d6c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:22.121225 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f7f9b582-f68a-43af-9787-052cdfee2d6c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:22.130084 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f7f9b582-f68a-43af-9787-052cdfee2d6c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:22.131748 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-f7f9b582-f68a-43af-9787-052cdfee2d6c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:22.133035 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-f7f9b582-f68a-43af-9787-052cdfee2d6c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.169145 Jun 23 16:10:22.136807 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 468/959] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:21 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:23.152370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4c4c8012-69c7-44fe-8239-6f44a1c068f3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:23.152932 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4c4c8012-69c7-44fe-8239-6f44a1c068f3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:23.160124 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c4c8012-69c7-44fe-8239-6f44a1c068f3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:23.160575 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c4c8012-69c7-44fe-8239-6f44a1c068f3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:23.161343 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c4c8012-69c7-44fe-8239-6f44a1c068f3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:23.161778 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4c4c8012-69c7-44fe-8239-6f44a1c068f3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:23.295778 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4c4c8012-69c7-44fe-8239-6f44a1c068f3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:23.304411 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4c4c8012-69c7-44fe-8239-6f44a1c068f3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:23.305900 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-4c4c8012-69c7-44fe-8239-6f44a1c068f3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:23.307077 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4c4c8012-69c7-44fe-8239-6f44a1c068f3 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.158764 Jun 23 16:10:23.307626 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 492/960] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:23 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:24.325572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dff576ef-e2fa-4dc9-b972-a198131ae219 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:24.326157 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dff576ef-e2fa-4dc9-b972-a198131ae219 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:24.332334 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dff576ef-e2fa-4dc9-b972-a198131ae219 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:24.332766 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dff576ef-e2fa-4dc9-b972-a198131ae219 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:24.333517 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dff576ef-e2fa-4dc9-b972-a198131ae219 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:24.333943 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dff576ef-e2fa-4dc9-b972-a198131ae219 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:24.467564 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dff576ef-e2fa-4dc9-b972-a198131ae219 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:24.475793 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dff576ef-e2fa-4dc9-b972-a198131ae219 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:24.477313 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-dff576ef-e2fa-4dc9-b972-a198131ae219 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:24.478486 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dff576ef-e2fa-4dc9-b972-a198131ae219 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.156789 Jun 23 16:10:24.479284 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 469/961] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:24 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:25.500402 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-43c97241-30c6-485d-82d3-1151ce70f0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:25.501125 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-43c97241-30c6-485d-82d3-1151ce70f0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:25.507768 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43c97241-30c6-485d-82d3-1151ce70f0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:25.508784 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43c97241-30c6-485d-82d3-1151ce70f0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:25.509024 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43c97241-30c6-485d-82d3-1151ce70f0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:25.509415 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-43c97241-30c6-485d-82d3-1151ce70f0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:25.648367 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-43c97241-30c6-485d-82d3-1151ce70f0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:25.657397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-43c97241-30c6-485d-82d3-1151ce70f0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:25.658979 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-43c97241-30c6-485d-82d3-1151ce70f0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:25.660150 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-43c97241-30c6-485d-82d3-1151ce70f0c9 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.164359 Jun 23 16:10:25.660704 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 493/962] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:25 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:26.678858 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-fb9e3217-1201-4cb1-98b6-8550a8417e0f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:26.679461 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-fb9e3217-1201-4cb1-98b6-8550a8417e0f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:26.686767 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fb9e3217-1201-4cb1-98b6-8550a8417e0f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:26.687220 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fb9e3217-1201-4cb1-98b6-8550a8417e0f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:26.687990 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fb9e3217-1201-4cb1-98b6-8550a8417e0f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:26.688428 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-fb9e3217-1201-4cb1-98b6-8550a8417e0f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:26.818989 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fb9e3217-1201-4cb1-98b6-8550a8417e0f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:26.827222 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fb9e3217-1201-4cb1-98b6-8550a8417e0f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:26.828814 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-fb9e3217-1201-4cb1-98b6-8550a8417e0f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:26.829947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-fb9e3217-1201-4cb1-98b6-8550a8417e0f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.155006 Jun 23 16:10:26.830505 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 470/963] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:26 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:27.848260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7a2fea1c-508e-46b8-a0a9-2a869caa6710 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:27.848908 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7a2fea1c-508e-46b8-a0a9-2a869caa6710 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:27.855182 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a2fea1c-508e-46b8-a0a9-2a869caa6710 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:27.855632 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a2fea1c-508e-46b8-a0a9-2a869caa6710 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:27.856397 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a2fea1c-508e-46b8-a0a9-2a869caa6710 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:27.856934 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7a2fea1c-508e-46b8-a0a9-2a869caa6710 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:27.984471 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7a2fea1c-508e-46b8-a0a9-2a869caa6710 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:27.992798 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7a2fea1c-508e-46b8-a0a9-2a869caa6710 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:27.994421 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7a2fea1c-508e-46b8-a0a9-2a869caa6710 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:27.995626 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7a2fea1c-508e-46b8-a0a9-2a869caa6710 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.151356 Jun 23 16:10:27.996191 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 494/964] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:27 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:29.013524 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-223ec034-26cd-47a0-a480-7c3bf4e18f01 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:29.014790 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-223ec034-26cd-47a0-a480-7c3bf4e18f01 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:29.021426 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-223ec034-26cd-47a0-a480-7c3bf4e18f01 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:29.022133 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-223ec034-26cd-47a0-a480-7c3bf4e18f01 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:29.022931 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-223ec034-26cd-47a0-a480-7c3bf4e18f01 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:29.023369 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-223ec034-26cd-47a0-a480-7c3bf4e18f01 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:29.155443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-223ec034-26cd-47a0-a480-7c3bf4e18f01 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:29.163275 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-223ec034-26cd-47a0-a480-7c3bf4e18f01 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:29.164779 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-223ec034-26cd-47a0-a480-7c3bf4e18f01 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:29.165926 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-223ec034-26cd-47a0-a480-7c3bf4e18f01 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.156291 Jun 23 16:10:29.166476 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 471/965] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:29 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:30.184445 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-28b83df2-f437-41e1-b31d-981ffb778b11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:30.185074 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-28b83df2-f437-41e1-b31d-981ffb778b11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:30.192314 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-28b83df2-f437-41e1-b31d-981ffb778b11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:30.192756 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-28b83df2-f437-41e1-b31d-981ffb778b11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:30.193508 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-28b83df2-f437-41e1-b31d-981ffb778b11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:30.193967 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-28b83df2-f437-41e1-b31d-981ffb778b11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:30.323340 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-28b83df2-f437-41e1-b31d-981ffb778b11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:30.332040 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-28b83df2-f437-41e1-b31d-981ffb778b11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:30.333685 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-28b83df2-f437-41e1-b31d-981ffb778b11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:30.334901 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-28b83df2-f437-41e1-b31d-981ffb778b11 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.154352 Jun 23 16:10:30.335462 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 495/966] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:30 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:31.352860 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-cc85185e-27f3-4ef3-896d-96ac0b55bcf2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:31.353463 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-cc85185e-27f3-4ef3-896d-96ac0b55bcf2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:31.359985 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc85185e-27f3-4ef3-896d-96ac0b55bcf2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:31.360430 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc85185e-27f3-4ef3-896d-96ac0b55bcf2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:31.361177 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc85185e-27f3-4ef3-896d-96ac0b55bcf2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:31.361643 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-cc85185e-27f3-4ef3-896d-96ac0b55bcf2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:31.491597 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cc85185e-27f3-4ef3-896d-96ac0b55bcf2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:31.499453 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cc85185e-27f3-4ef3-896d-96ac0b55bcf2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:31.501022 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-cc85185e-27f3-4ef3-896d-96ac0b55bcf2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:31.502170 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-cc85185e-27f3-4ef3-896d-96ac0b55bcf2 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.153195 Jun 23 16:10:31.502807 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 472/967] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:31 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:32.521029 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-b3a96d69-30b1-47ec-b835-44d690a67e44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:32.521586 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-b3a96d69-30b1-47ec-b835-44d690a67e44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:32.528405 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3a96d69-30b1-47ec-b835-44d690a67e44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:32.528849 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3a96d69-30b1-47ec-b835-44d690a67e44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:32.529612 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3a96d69-30b1-47ec-b835-44d690a67e44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:32.530039 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-b3a96d69-30b1-47ec-b835-44d690a67e44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:32.661786 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b3a96d69-30b1-47ec-b835-44d690a67e44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:32.669694 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b3a96d69-30b1-47ec-b835-44d690a67e44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:32.671527 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-b3a96d69-30b1-47ec-b835-44d690a67e44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:32.672671 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-b3a96d69-30b1-47ec-b835-44d690a67e44 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.155654 Jun 23 16:10:32.673327 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 496/968] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:32 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:33.692032 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-bb67aa9f-1f44-4ebb-ba94-67ac48d4156b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:33.692636 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-bb67aa9f-1f44-4ebb-ba94-67ac48d4156b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:33.699229 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb67aa9f-1f44-4ebb-ba94-67ac48d4156b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:33.699672 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb67aa9f-1f44-4ebb-ba94-67ac48d4156b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:33.700429 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb67aa9f-1f44-4ebb-ba94-67ac48d4156b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:33.700863 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-bb67aa9f-1f44-4ebb-ba94-67ac48d4156b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:33.829434 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bb67aa9f-1f44-4ebb-ba94-67ac48d4156b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:33.837356 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bb67aa9f-1f44-4ebb-ba94-67ac48d4156b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:33.838894 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-bb67aa9f-1f44-4ebb-ba94-67ac48d4156b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:33.840056 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-bb67aa9f-1f44-4ebb-ba94-67ac48d4156b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.151961 Jun 23 16:10:33.840614 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 473/969] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:33 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:34.387317 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-d3c2077c-56b6-4a0b-b6f7-8ab36281c7e2 req-11246e33-5a36-4c40-a5fc-6231492db621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7563514-d6f1-44c1-b8ae-7008e842faf8", "name": "network-vif-plugged", "status": "completed", "tag": "afe54005-6126-4438-ba09-6763f07e66d9"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:10:34.397800 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-d3c2077c-56b6-4a0b-b6f7-8ab36281c7e2 req-11246e33-5a36-4c40-a5fc-6231492db621 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:34.398250 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-d3c2077c-56b6-4a0b-b6f7-8ab36281c7e2 req-11246e33-5a36-4c40-a5fc-6231492db621 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:34.411766 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-d3c2077c-56b6-4a0b-b6f7-8ab36281c7e2 req-11246e33-5a36-4c40-a5fc-6231492db621 service nova] Creating event network-vif-plugged:afe54005-6126-4438-ba09-6763f07e66d9 for instance b7563514-d6f1-44c1-b8ae-7008e842faf8 on hv-cinder-83538 Jun 23 16:10:34.417845 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-d3c2077c-56b6-4a0b-b6f7-8ab36281c7e2 req-11246e33-5a36-4c40-a5fc-6231492db621 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035833 Jun 23 16:10:34.418653 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 497/970] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:10:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:10:34.859605 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2c2c5a2e-c87f-49b5-8506-9bd4d6f2e56d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:34.860222 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2c2c5a2e-c87f-49b5-8506-9bd4d6f2e56d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:34.866873 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c2c5a2e-c87f-49b5-8506-9bd4d6f2e56d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:34.867322 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c2c5a2e-c87f-49b5-8506-9bd4d6f2e56d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:34.868087 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c2c5a2e-c87f-49b5-8506-9bd4d6f2e56d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:34.868522 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2c2c5a2e-c87f-49b5-8506-9bd4d6f2e56d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:35.000490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2c2c5a2e-c87f-49b5-8506-9bd4d6f2e56d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:35.008336 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2c2c5a2e-c87f-49b5-8506-9bd4d6f2e56d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:35.009814 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2c2c5a2e-c87f-49b5-8506-9bd4d6f2e56d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:35.010987 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2c2c5a2e-c87f-49b5-8506-9bd4d6f2e56d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.156030 Jun 23 16:10:35.011543 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 474/971] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:34 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:36.029672 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9b0aef62-8ae9-446d-ac46-536ddd87ce2a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:36.030375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9b0aef62-8ae9-446d-ac46-536ddd87ce2a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:36.037679 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9b0aef62-8ae9-446d-ac46-536ddd87ce2a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:36.038139 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9b0aef62-8ae9-446d-ac46-536ddd87ce2a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:36.038935 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9b0aef62-8ae9-446d-ac46-536ddd87ce2a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:36.039376 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9b0aef62-8ae9-446d-ac46-536ddd87ce2a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:36.174490 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9b0aef62-8ae9-446d-ac46-536ddd87ce2a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:36.182780 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9b0aef62-8ae9-446d-ac46-536ddd87ce2a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:36.184325 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9b0aef62-8ae9-446d-ac46-536ddd87ce2a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:36.185489 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9b0aef62-8ae9-446d-ac46-536ddd87ce2a tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.160172 Jun 23 16:10:36.186050 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 498/972] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:36 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:37.204015 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-509fc902-30d4-4d42-9b23-b6970daf8306 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:37.204622 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-509fc902-30d4-4d42-9b23-b6970daf8306 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:37.211138 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-509fc902-30d4-4d42-9b23-b6970daf8306 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:37.211577 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-509fc902-30d4-4d42-9b23-b6970daf8306 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:37.212328 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-509fc902-30d4-4d42-9b23-b6970daf8306 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:37.212765 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-509fc902-30d4-4d42-9b23-b6970daf8306 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:37.344596 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-509fc902-30d4-4d42-9b23-b6970daf8306 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:37.352481 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-509fc902-30d4-4d42-9b23-b6970daf8306 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:37.353966 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-509fc902-30d4-4d42-9b23-b6970daf8306 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:37.355157 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-509fc902-30d4-4d42-9b23-b6970daf8306 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1731 microversion: 2.20 time: 0.155202 Jun 23 16:10:37.355717 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 475/973] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:37 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:10:38.373496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-be8f8a6c-142b-4f12-bdf5-27ebda472460 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:10:38.374135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-be8f8a6c-142b-4f12-bdf5-27ebda472460 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:10:38.381360 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be8f8a6c-142b-4f12-bdf5-27ebda472460 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:38.381807 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be8f8a6c-142b-4f12-bdf5-27ebda472460 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:38.382572 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be8f8a6c-142b-4f12-bdf5-27ebda472460 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:10:38.383037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be8f8a6c-142b-4f12-bdf5-27ebda472460 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:10:38.511143 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-be8f8a6c-142b-4f12-bdf5-27ebda472460 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:38.518976 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-be8f8a6c-142b-4f12-bdf5-27ebda472460 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:38.520466 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-be8f8a6c-142b-4f12-bdf5-27ebda472460 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:10:38.521606 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-be8f8a6c-142b-4f12-bdf5-27ebda472460 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1718 microversion: 2.20 time: 0.152086 Jun 23 16:10:38.522413 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 499/974] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:10:38 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1718 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:11:11.354355 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1509830658", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1983304844", "security_groups": [{"name": "tempest-secgroup-smoke-1309684319"}], "block_device_mapping_v2": [{"uuid": "2984556e-3d70-4463-a8bf-6bb53bc43b04", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ebbee555-602b-4494-b3d4-95250f3b8a84"}]}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:11:11.363237 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=21 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:11.363910 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:11.574048 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.network.neutron [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] validate_networks() for [('ebbee555-602b-4494-b3d4-95250f3b8a84', None, None, None, None, None)] {{(pid=117891) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 16:11:11.955312 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Flavor limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 16:11:11.956250 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Image limits 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 16:11:11.956723 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Flavor pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 16:11:11.957133 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Image pref 0:0:0 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 16:11:11.957542 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.virt.hardware [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117891) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 16:11:11.966280 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:11.966753 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:11.967556 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:11.967991 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:11.985855 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Getting quotas for project 42ebe5dc582e4a6b92d4f18002a0ffba. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 16:11:11.989939 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.quota [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Getting quotas for user c953617a01f1401c966c16467138d628 and project 42ebe5dc582e4a6b92d4f18002a0ffba. Resources: {'instances', 'cores', 'ram'} {{(pid=117891) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 16:11:12.046772 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Going to run 1 instances... {{(pid=117891) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 16:11:12.048826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2984556e-3d70-4463-a8bf-6bb53bc43b04',volume_size=None,volume_type=None)] {{(pid=117891) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 16:11:12.182231 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-271cfbb1-5860-4cfe-96e7-bcc4c8197d2d tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.831688 Jun 23 16:11:12.183180 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 476/975] 10.222.0.46 () {60 vars in 1146 bytes} [Thu Jun 23 16:11:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 16:11:12.193786 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-68832afd-63a3-470a-8d93-17a39f9466dd tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:12.194494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-68832afd-63a3-470a-8d93-17a39f9466dd tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:12.196955 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=23 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:12.198318 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=66 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:12.361115 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-68832afd-63a3-470a-8d93-17a39f9466dd tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:12.370253 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-68832afd-63a3-470a-8d93-17a39f9466dd tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1095 microversion: 2.1 time: 0.180770 Jun 23 16:11:12.370738 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 500/976] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:12 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1095 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:13.387785 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-d2ab6223-b3da-4441-868a-c8cbacafda17 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:13.388494 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-d2ab6223-b3da-4441-868a-c8cbacafda17 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:13.395080 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d2ab6223-b3da-4441-868a-c8cbacafda17 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:13.395528 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d2ab6223-b3da-4441-868a-c8cbacafda17 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:13.396297 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d2ab6223-b3da-4441-868a-c8cbacafda17 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:13.396734 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-d2ab6223-b3da-4441-868a-c8cbacafda17 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:13.489168 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-d2ab6223-b3da-4441-868a-c8cbacafda17 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:13.496732 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-d2ab6223-b3da-4441-868a-c8cbacafda17 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1211 microversion: 2.1 time: 0.113137 Jun 23 16:11:13.497332 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 477/977] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:13 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:14.515110 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8eb82648-b2b8-4351-9d5f-020ec9ba3946 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:14.515727 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8eb82648-b2b8-4351-9d5f-020ec9ba3946 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:14.522861 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8eb82648-b2b8-4351-9d5f-020ec9ba3946 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:14.523615 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8eb82648-b2b8-4351-9d5f-020ec9ba3946 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:14.524341 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8eb82648-b2b8-4351-9d5f-020ec9ba3946 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:14.524776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8eb82648-b2b8-4351-9d5f-020ec9ba3946 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:14.592591 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-b182d037-a86b-45e3-b944-1f0945ca9c8b req-40b112f5-0782-4995-ae83-8de24f6a587b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d44700-eff4-486f-a021-1fe51ed1a8d4", "tag": "d8fef5ea-3fae-4689-872c-2863221089b0"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:11:14.604074 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b182d037-a86b-45e3-b944-1f0945ca9c8b req-40b112f5-0782-4995-ae83-8de24f6a587b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:14.604774 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-b182d037-a86b-45e3-b944-1f0945ca9c8b req-40b112f5-0782-4995-ae83-8de24f6a587b service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:14.636004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-b182d037-a86b-45e3-b944-1f0945ca9c8b req-40b112f5-0782-4995-ae83-8de24f6a587b service nova] Creating event network-changed:d8fef5ea-3fae-4689-872c-2863221089b0 for instance 19d44700-eff4-486f-a021-1fe51ed1a8d4 on hv-cinder-83538 Jun 23 16:11:14.645998 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-b182d037-a86b-45e3-b944-1f0945ca9c8b req-40b112f5-0782-4995-ae83-8de24f6a587b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058475 Jun 23 16:11:14.654802 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 478/978] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:11:14.706531 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8eb82648-b2b8-4351-9d5f-020ec9ba3946 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:14.717929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8eb82648-b2b8-4351-9d5f-020ec9ba3946 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.206328 Jun 23 16:11:14.718538 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 501/979] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:14 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:14.804164 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-4e63c010-d977-4cba-9903-72a8b3e211df tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:14.805092 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-4e63c010-d977-4cba-9903-72a8b3e211df tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:14.811838 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e63c010-d977-4cba-9903-72a8b3e211df tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:14.812385 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e63c010-d977-4cba-9903-72a8b3e211df tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:14.813232 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e63c010-d977-4cba-9903-72a8b3e211df tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:14.813804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-4e63c010-d977-4cba-9903-72a8b3e211df tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:14.839281 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-4e63c010-d977-4cba-9903-72a8b3e211df tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/ips" status: 200 len: 150 microversion: 2.1 time: 0.039715 Jun 23 16:11:14.839875 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 479/980] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 23 16:11:14 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:15.735666 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-9976f54c-dd7e-4c2d-85f2-d2e56622c422 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:15.736253 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-9976f54c-dd7e-4c2d-85f2-d2e56622c422 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:15.744004 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9976f54c-dd7e-4c2d-85f2-d2e56622c422 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:15.744444 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9976f54c-dd7e-4c2d-85f2-d2e56622c422 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:15.745202 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9976f54c-dd7e-4c2d-85f2-d2e56622c422 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:15.745635 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-9976f54c-dd7e-4c2d-85f2-d2e56622c422 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:15.876876 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-9976f54c-dd7e-4c2d-85f2-d2e56622c422 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:15.885736 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-9976f54c-dd7e-4c2d-85f2-d2e56622c422 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.153935 Jun 23 16:11:15.886333 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 502/981] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:15 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:16.197404 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9e5f6abf-c0b0-4738-9481-1864fd2ae2b5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "493008ad-4e46-4a7c-a699-1960e0414b83"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:11:16.198467 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9e5f6abf-c0b0-4738-9481-1864fd2ae2b5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:16.205004 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e5f6abf-c0b0-4738-9481-1864fd2ae2b5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:16.205442 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e5f6abf-c0b0-4738-9481-1864fd2ae2b5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:16.206202 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e5f6abf-c0b0-4738-9481-1864fd2ae2b5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:16.206626 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9e5f6abf-c0b0-4738-9481-1864fd2ae2b5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:16.563876 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9e5f6abf-c0b0-4738-9481-1864fd2ae2b5 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "POST /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.370218 Jun 23 16:11:16.564490 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 480/982] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:11:16 2022] POST /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:16.903303 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8a4e874c-ba8a-4671-9778-33750f51add8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:16.903931 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8a4e874c-ba8a-4671-9778-33750f51add8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:16.911630 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a4e874c-ba8a-4671-9778-33750f51add8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:16.912076 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a4e874c-ba8a-4671-9778-33750f51add8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:16.912830 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a4e874c-ba8a-4671-9778-33750f51add8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:16.913259 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a4e874c-ba8a-4671-9778-33750f51add8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:17.046914 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8a4e874c-ba8a-4671-9778-33750f51add8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:17.055468 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8a4e874c-ba8a-4671-9778-33750f51add8 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.155967 Jun 23 16:11:17.056046 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 503/983] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:16 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:18.072373 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3a34fcc5-3cac-44ca-bf93-39c372874f9f tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:18.073730 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3a34fcc5-3cac-44ca-bf93-39c372874f9f tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:18.081096 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3a34fcc5-3cac-44ca-bf93-39c372874f9f tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:18.081542 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3a34fcc5-3cac-44ca-bf93-39c372874f9f tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:18.082315 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3a34fcc5-3cac-44ca-bf93-39c372874f9f tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:18.082768 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3a34fcc5-3cac-44ca-bf93-39c372874f9f tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:18.219511 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-3a34fcc5-3cac-44ca-bf93-39c372874f9f tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:18.227502 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3a34fcc5-3cac-44ca-bf93-39c372874f9f tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.159358 Jun 23 16:11:18.228068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 481/984] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:18 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:11:19.244797 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-067e1982-9b0a-403d-9d06-d5e0d2944e36 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:19.245417 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-067e1982-9b0a-403d-9d06-d5e0d2944e36 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:19.252073 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-067e1982-9b0a-403d-9d06-d5e0d2944e36 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:19.252519 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-067e1982-9b0a-403d-9d06-d5e0d2944e36 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:19.253294 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-067e1982-9b0a-403d-9d06-d5e0d2944e36 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:19.254398 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-067e1982-9b0a-403d-9d06-d5e0d2944e36 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:19.393433 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-067e1982-9b0a-403d-9d06-d5e0d2944e36 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:19.405887 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-067e1982-9b0a-403d-9d06-d5e0d2944e36 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.164860 Jun 23 16:11:19.406484 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 504/985] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:19 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:20.424395 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-e532f407-8e05-416f-8a92-1076895cc515 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:20.425006 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-e532f407-8e05-416f-8a92-1076895cc515 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:20.432138 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e532f407-8e05-416f-8a92-1076895cc515 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:20.432583 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e532f407-8e05-416f-8a92-1076895cc515 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:20.433457 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e532f407-8e05-416f-8a92-1076895cc515 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:20.433898 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-e532f407-8e05-416f-8a92-1076895cc515 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:20.564106 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-e532f407-8e05-416f-8a92-1076895cc515 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:20.572177 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-e532f407-8e05-416f-8a92-1076895cc515 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.151837 Jun 23 16:11:20.572763 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 482/986] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:20 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:21.589314 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-24d22ef6-ad5b-464f-adf0-09e5d47bd550 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:21.589926 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-24d22ef6-ad5b-464f-adf0-09e5d47bd550 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:21.596432 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-24d22ef6-ad5b-464f-adf0-09e5d47bd550 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:21.596874 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-24d22ef6-ad5b-464f-adf0-09e5d47bd550 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:21.597625 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-24d22ef6-ad5b-464f-adf0-09e5d47bd550 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:21.598054 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-24d22ef6-ad5b-464f-adf0-09e5d47bd550 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:21.725506 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-24d22ef6-ad5b-464f-adf0-09e5d47bd550 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:21.732996 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-24d22ef6-ad5b-464f-adf0-09e5d47bd550 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.147587 Jun 23 16:11:21.733557 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 505/987] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:21 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:22.750050 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2856673a-9d10-4443-b717-fc8088b51fd4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:22.750658 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2856673a-9d10-4443-b717-fc8088b51fd4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:22.753089 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:22.754258 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell0:SELECT=6 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:22.760193 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2856673a-9d10-4443-b717-fc8088b51fd4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:22.760639 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2856673a-9d10-4443-b717-fc8088b51fd4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:22.761410 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2856673a-9d10-4443-b717-fc8088b51fd4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:22.761844 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2856673a-9d10-4443-b717-fc8088b51fd4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:22.902036 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2856673a-9d10-4443-b717-fc8088b51fd4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:22.909568 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2856673a-9d10-4443-b717-fc8088b51fd4 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.163336 Jun 23 16:11:22.910147 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 483/988] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:22 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:23.925757 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ade143b0-c79d-417b-853d-fdfa1d544ed0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:23.926376 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ade143b0-c79d-417b-853d-fdfa1d544ed0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:23.928317 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell0:SELECT=2 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:23.934388 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ade143b0-c79d-417b-853d-fdfa1d544ed0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:23.934866 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ade143b0-c79d-417b-853d-fdfa1d544ed0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:23.935715 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ade143b0-c79d-417b-853d-fdfa1d544ed0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:23.936083 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ade143b0-c79d-417b-853d-fdfa1d544ed0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:24.088939 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-ade143b0-c79d-417b-853d-fdfa1d544ed0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:24.096479 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ade143b0-c79d-417b-853d-fdfa1d544ed0 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.174652 Jun 23 16:11:24.097041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 506/989] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:23 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:24.173659 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2429cb12-a1d1-4d81-a55f-e330e5c96a76 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:24.174154 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2429cb12-a1d1-4d81-a55f-e330e5c96a76 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:24.180611 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2429cb12-a1d1-4d81-a55f-e330e5c96a76 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:24.181057 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2429cb12-a1d1-4d81-a55f-e330e5c96a76 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:24.181812 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2429cb12-a1d1-4d81-a55f-e330e5c96a76 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:24.182245 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2429cb12-a1d1-4d81-a55f-e330e5c96a76 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:24.263926 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-2429cb12-a1d1-4d81-a55f-e330e5c96a76 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lazy-loading 'services' on Instance uuid 17e9ee44-03a4-42af-92f2-eb421df3a418 {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:11:24.339795 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2429cb12-a1d1-4d81-a55f-e330e5c96a76 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/os-volume_attachments/493008ad-4e46-4a7c-a699-1960e0414b83" status: 202 len: 0 microversion: 2.1 time: 0.170158 Jun 23 16:11:24.340375 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 484/990] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 23 16:11:24 2022] DELETE /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/os-volume_attachments/493008ad-4e46-4a7c-a699-1960e0414b83 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:11:24.348807 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-141a31e6-5cac-4a3a-8964-240b9e5ce2fb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:24.349836 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-141a31e6-5cac-4a3a-8964-240b9e5ce2fb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:24.355905 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-141a31e6-5cac-4a3a-8964-240b9e5ce2fb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:24.356356 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-141a31e6-5cac-4a3a-8964-240b9e5ce2fb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:24.357130 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-141a31e6-5cac-4a3a-8964-240b9e5ce2fb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:24.357576 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-141a31e6-5cac-4a3a-8964-240b9e5ce2fb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:24.387561 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-141a31e6-5cac-4a3a-8964-240b9e5ce2fb tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042695 Jun 23 16:11:24.388164 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 507/991] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:11:24 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:11:25.116634 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-9d016d49-a59a-45a6-8306-c770984f1d9e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:25.117328 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-9d016d49-a59a-45a6-8306-c770984f1d9e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:25.123620 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d016d49-a59a-45a6-8306-c770984f1d9e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:25.124065 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d016d49-a59a-45a6-8306-c770984f1d9e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:25.124829 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d016d49-a59a-45a6-8306-c770984f1d9e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:25.125376 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-9d016d49-a59a-45a6-8306-c770984f1d9e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:25.400272 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7aa2881a-221e-4a71-848f-797186fb8b23 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:25.401303 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7aa2881a-221e-4a71-848f-797186fb8b23 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:25.407117 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-9d016d49-a59a-45a6-8306-c770984f1d9e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:25.408072 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7aa2881a-221e-4a71-848f-797186fb8b23 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:25.408521 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7aa2881a-221e-4a71-848f-797186fb8b23 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:25.409300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7aa2881a-221e-4a71-848f-797186fb8b23 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:25.410309 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7aa2881a-221e-4a71-848f-797186fb8b23 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:25.415192 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-9d016d49-a59a-45a6-8306-c770984f1d9e tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.304601 Jun 23 16:11:25.415765 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 485/992] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:25 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:25.440144 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7aa2881a-221e-4a71-848f-797186fb8b23 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044043 Jun 23 16:11:25.440706 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 508/993] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:11:25 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 16:11:25.497209 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-6699bc9c-1a42-4dd5-a374-01ba3b6a0245 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:25.497713 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6699bc9c-1a42-4dd5-a374-01ba3b6a0245 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:25.504199 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6699bc9c-1a42-4dd5-a374-01ba3b6a0245 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:25.504647 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6699bc9c-1a42-4dd5-a374-01ba3b6a0245 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:25.505401 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6699bc9c-1a42-4dd5-a374-01ba3b6a0245 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:25.505836 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-6699bc9c-1a42-4dd5-a374-01ba3b6a0245 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:25.530841 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-6699bc9c-1a42-4dd5-a374-01ba3b6a0245 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:11:25.604802 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-6699bc9c-1a42-4dd5-a374-01ba3b6a0245 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 204 len: 0 microversion: 2.1 time: 0.110995 Jun 23 16:11:25.605412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 486/994] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:11:25 2022] DELETE /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:11:25.613811 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-7737c012-78d4-4fb7-8384-51bb0d94f315 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:25.614430 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-7737c012-78d4-4fb7-8384-51bb0d94f315 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:25.620595 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7737c012-78d4-4fb7-8384-51bb0d94f315 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:25.621050 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7737c012-78d4-4fb7-8384-51bb0d94f315 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:25.621814 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7737c012-78d4-4fb7-8384-51bb0d94f315 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:25.622255 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-7737c012-78d4-4fb7-8384-51bb0d94f315 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:25.758713 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-7737c012-78d4-4fb7-8384-51bb0d94f315 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:25.766274 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-7737c012-78d4-4fb7-8384-51bb0d94f315 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1680 microversion: 2.1 time: 0.156403 Jun 23 16:11:25.766863 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 509/995] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:25 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:11:26.434222 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-2f32d42f-7879-4c48-a49c-109dc2b31076 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:26.434947 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-2f32d42f-7879-4c48-a49c-109dc2b31076 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:26.441598 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f32d42f-7879-4c48-a49c-109dc2b31076 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:26.442043 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f32d42f-7879-4c48-a49c-109dc2b31076 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:26.442833 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f32d42f-7879-4c48-a49c-109dc2b31076 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:26.443272 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-2f32d42f-7879-4c48-a49c-109dc2b31076 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:26.584172 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-2f32d42f-7879-4c48-a49c-109dc2b31076 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:26.592077 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-2f32d42f-7879-4c48-a49c-109dc2b31076 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.161975 Jun 23 16:11:26.592663 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 487/996] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:26 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:11:26.640596 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-913ed0f6-bed3-4022-b14a-3f8ec9dec33c req-bc344d11-a707-41de-8780-66b5591769e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d44700-eff4-486f-a021-1fe51ed1a8d4", "name": "network-vif-plugged", "status": "completed", "tag": "d8fef5ea-3fae-4689-872c-2863221089b0"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:11:26.650026 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-913ed0f6-bed3-4022-b14a-3f8ec9dec33c req-bc344d11-a707-41de-8780-66b5591769e4 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:26.650764 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-913ed0f6-bed3-4022-b14a-3f8ec9dec33c req-bc344d11-a707-41de-8780-66b5591769e4 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:26.663146 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-913ed0f6-bed3-4022-b14a-3f8ec9dec33c req-bc344d11-a707-41de-8780-66b5591769e4 service nova] Creating event network-vif-plugged:d8fef5ea-3fae-4689-872c-2863221089b0 for instance 19d44700-eff4-486f-a021-1fe51ed1a8d4 on hv-cinder-83538 Jun 23 16:11:26.668227 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-913ed0f6-bed3-4022-b14a-3f8ec9dec33c req-bc344d11-a707-41de-8780-66b5591769e4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031574 Jun 23 16:11:26.668822 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 510/997] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:26.784576 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-13fed73c-83e7-4122-830b-e53adb5b0a3f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:26.785760 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-13fed73c-83e7-4122-830b-e53adb5b0a3f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:26.792474 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-13fed73c-83e7-4122-830b-e53adb5b0a3f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:26.792912 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-13fed73c-83e7-4122-830b-e53adb5b0a3f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:26.793659 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-13fed73c-83e7-4122-830b-e53adb5b0a3f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:26.794089 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-13fed73c-83e7-4122-830b-e53adb5b0a3f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:26.923120 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-13fed73c-83e7-4122-830b-e53adb5b0a3f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:26.930607 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-13fed73c-83e7-4122-830b-e53adb5b0a3f tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1680 microversion: 2.1 time: 0.150008 Jun 23 16:11:26.931192 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 488/998] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:26 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:27.610494 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d802ee35-8ed3-4ae0-8bed-3a7410e3cb4a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:27.611327 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d802ee35-8ed3-4ae0-8bed-3a7410e3cb4a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:27.618274 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d802ee35-8ed3-4ae0-8bed-3a7410e3cb4a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:27.618739 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d802ee35-8ed3-4ae0-8bed-3a7410e3cb4a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:27.619505 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d802ee35-8ed3-4ae0-8bed-3a7410e3cb4a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:27.619939 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d802ee35-8ed3-4ae0-8bed-3a7410e3cb4a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:27.755548 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-d802ee35-8ed3-4ae0-8bed-3a7410e3cb4a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:27.762949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d802ee35-8ed3-4ae0-8bed-3a7410e3cb4a tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.157199 Jun 23 16:11:27.763513 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 511/999] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:27 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:27.947521 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a39a054c-63ef-45a6-86f4-e6b68d00c1b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:27.948161 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a39a054c-63ef-45a6-86f4-e6b68d00c1b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:27.954667 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a39a054c-63ef-45a6-86f4-e6b68d00c1b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:27.955142 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a39a054c-63ef-45a6-86f4-e6b68d00c1b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:27.955904 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a39a054c-63ef-45a6-86f4-e6b68d00c1b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:27.956343 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a39a054c-63ef-45a6-86f4-e6b68d00c1b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:28.088056 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-a39a054c-63ef-45a6-86f4-e6b68d00c1b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:28.096150 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a39a054c-63ef-45a6-86f4-e6b68d00c1b9 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1680 microversion: 2.1 time: 0.152198 Jun 23 16:11:28.096396 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 489/1000] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:27 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:28.780232 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-207a271b-234f-48b3-a809-3c2663647125 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:28.780857 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-207a271b-234f-48b3-a809-3c2663647125 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:28.787437 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-207a271b-234f-48b3-a809-3c2663647125 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:28.787889 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-207a271b-234f-48b3-a809-3c2663647125 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:28.788660 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-207a271b-234f-48b3-a809-3c2663647125 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:28.789100 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-207a271b-234f-48b3-a809-3c2663647125 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:28.940449 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-207a271b-234f-48b3-a809-3c2663647125 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:28.949326 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-207a271b-234f-48b3-a809-3c2663647125 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1267 microversion: 2.1 time: 0.172947 Jun 23 16:11:28.949916 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 512/1001] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:28 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:29.113747 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7e95eeae-2bda-4779-9fc9-888e4160317a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:29.114363 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7e95eeae-2bda-4779-9fc9-888e4160317a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:29.120980 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e95eeae-2bda-4779-9fc9-888e4160317a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:29.121425 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e95eeae-2bda-4779-9fc9-888e4160317a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:29.122202 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e95eeae-2bda-4779-9fc9-888e4160317a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:29.122638 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7e95eeae-2bda-4779-9fc9-888e4160317a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:29.150936 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:29.229953 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7e95eeae-2bda-4779-9fc9-888e4160317a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac5e323b42f41859c85709a2b49623b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2063fb24abb5408794361a9032e56d3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:29.232874 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-d8e72080-b3b1-462e-b479-5adf46a3929f req-9ff5bce0-8819-44be-b000-59bf24361be0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17e9ee44-03a4-42af-92f2-eb421df3a418", "name": "network-vif-deleted", "tag": "259d895d-0199-477c-88c4-8e9dc152b324"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:11:29.241236 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7e95eeae-2bda-4779-9fc9-888e4160317a tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 200 len: 1613 microversion: 2.1 time: 0.131871 Jun 23 16:11:29.242263 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 490/1002] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:29 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 1613 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:29.265954 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-d8e72080-b3b1-462e-b479-5adf46a3929f req-9ff5bce0-8819-44be-b000-59bf24361be0 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:29.266394 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-d8e72080-b3b1-462e-b479-5adf46a3929f req-9ff5bce0-8819-44be-b000-59bf24361be0 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:29.282110 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-d8e72080-b3b1-462e-b479-5adf46a3929f req-9ff5bce0-8819-44be-b000-59bf24361be0 service nova] Creating event network-vif-deleted:259d895d-0199-477c-88c4-8e9dc152b324 for instance 17e9ee44-03a4-42af-92f2-eb421df3a418 on hv-cinder-83538 Jun 23 16:11:29.288361 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-d8e72080-b3b1-462e-b479-5adf46a3929f req-9ff5bce0-8819-44be-b000-59bf24361be0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067000 Jun 23 16:11:29.292938 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 513/1003] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:29.967098 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7b475b43-3130-4e99-b6ad-870313c4ea04 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:29.967794 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7b475b43-3130-4e99-b6ad-870313c4ea04 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:29.974726 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b475b43-3130-4e99-b6ad-870313c4ea04 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:29.975406 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b475b43-3130-4e99-b6ad-870313c4ea04 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:29.976350 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b475b43-3130-4e99-b6ad-870313c4ea04 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:29.976956 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7b475b43-3130-4e99-b6ad-870313c4ea04 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:30.113879 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-7b475b43-3130-4e99-b6ad-870313c4ea04 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:30.121712 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7b475b43-3130-4e99-b6ad-870313c4ea04 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1453 microversion: 2.1 time: 0.159114 Jun 23 16:11:30.122278 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 491/1004] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:29 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:30.139245 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-c5092ecf-20e2-476e-b9da-89fa99363b75 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:30.139944 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-c5092ecf-20e2-476e-b9da-89fa99363b75 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] [instance: 19d44700-eff4-486f-a021-1fe51ed1a8d4] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:30.147083 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5092ecf-20e2-476e-b9da-89fa99363b75 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:30.147535 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5092ecf-20e2-476e-b9da-89fa99363b75 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:30.148311 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5092ecf-20e2-476e-b9da-89fa99363b75 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:30.148999 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-c5092ecf-20e2-476e-b9da-89fa99363b75 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:30.259527 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dc9d518b-9a6d-4973-b147-de074ccaf614 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:30.260301 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dc9d518b-9a6d-4973-b147-de074ccaf614 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:30.266608 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc9d518b-9a6d-4973-b147-de074ccaf614 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:30.267179 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc9d518b-9a6d-4973-b147-de074ccaf614 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:30.268065 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc9d518b-9a6d-4973-b147-de074ccaf614 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:30.268612 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc9d518b-9a6d-4973-b147-de074ccaf614 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:30.284517 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-dc9d518b-9a6d-4973-b147-de074ccaf614 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dc9d518b-9a6d-4973-b147-de074ccaf614 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 HTTP/1.1 Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:11:30.286446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:30.287932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '17e9ee44-03a4-42af-92f2-eb421df3a418'} Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:11:30.288796 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:30.290127 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:30.292297 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dc9d518b-9a6d-4973-b147-de074ccaf614 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:11:30.292297 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dc9d518b-9a6d-4973-b147-de074ccaf614 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 404 len: 111 microversion: 2.1 time: 0.032377 Jun 23 16:11:30.292540 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-c5092ecf-20e2-476e-b9da-89fa99363b75 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c953617a01f1401c966c16467138d628', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42ebe5dc582e4a6b92d4f18002a0ffba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:30.292664 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 492/1005] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:30 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 16:11:30.297608 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-15e69897-f8ec-4ace-a97e-4fda860f0786 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '.version_select at 0x7fe291d64dc0>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:30.297882 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-c5092ecf-20e2-476e-b9da-89fa99363b75 tempest-TestVolumeBootPattern-389253357 tempest-TestVolumeBootPattern-389253357-project] 10.222.0.46 "GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4" status: 200 len: 1453 microversion: 2.1 time: 0.163146 Jun 23 16:11:30.298306 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 514/1006] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:30 2022] GET /compute/v2.1/servers/19d44700-eff4-486f-a021-1fe51ed1a8d4 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:30.326356 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-15e69897-f8ec-4ace-a97e-4fda860f0786 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-712713560" status: 202 len: 0 microversion: 2.1 time: 0.032477 Jun 23 16:11:30.327432 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 493/1007] 10.222.0.46 () {58 vars in 1217 bytes} [Thu Jun 23 16:11:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-712713560 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:11:32.128115 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-c8655eef-54e6-4e39-8149-a3a74a144f3e req-59ca8381-d2cd-405a-a2fa-0f9e01a1556e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d44700-eff4-486f-a021-1fe51ed1a8d4", "tag": "d8fef5ea-3fae-4689-872c-2863221089b0"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:11:32.137457 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-c8655eef-54e6-4e39-8149-a3a74a144f3e req-59ca8381-d2cd-405a-a2fa-0f9e01a1556e service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:32.137970 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-c8655eef-54e6-4e39-8149-a3a74a144f3e req-59ca8381-d2cd-405a-a2fa-0f9e01a1556e service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:32.149847 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-c8655eef-54e6-4e39-8149-a3a74a144f3e req-59ca8381-d2cd-405a-a2fa-0f9e01a1556e service nova] Creating event network-changed:d8fef5ea-3fae-4689-872c-2863221089b0 for instance 19d44700-eff4-486f-a021-1fe51ed1a8d4 on hv-cinder-83538 Jun 23 16:11:32.154806 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-c8655eef-54e6-4e39-8149-a3a74a144f3e req-59ca8381-d2cd-405a-a2fa-0f9e01a1556e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030345 Jun 23 16:11:32.155439 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 515/1008] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:32.446990 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-939cfc94-6e8d-470b-b847-1eaea185a316 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:32.447497 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-939cfc94-6e8d-470b-b847-1eaea185a316 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:32.454642 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-939cfc94-6e8d-470b-b847-1eaea185a316 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:32.455114 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-939cfc94-6e8d-470b-b847-1eaea185a316 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:32.455872 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-939cfc94-6e8d-470b-b847-1eaea185a316 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:32.456297 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-939cfc94-6e8d-470b-b847-1eaea185a316 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:32.470509 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-939cfc94-6e8d-470b-b847-1eaea185a316 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-939cfc94-6e8d-470b-b847-1eaea185a316 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 HTTP/1.1 Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:11:32.472851 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:32.474469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '17e9ee44-03a4-42af-92f2-eb421df3a418'} Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:11:32.475348 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:32.476777 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:32.478179 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-939cfc94-6e8d-470b-b847-1eaea185a316 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:11:32.478179 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-939cfc94-6e8d-470b-b847-1eaea185a316 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 404 len: 111 microversion: 2.1 time: 0.031998 Jun 23 16:11:32.478179 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 494/1009] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:11:32 2022] DELETE /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:11:32.483655 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1fdc3f7c-ecc9-4194-a36b-9065dfd9fc93 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:32.484346 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1fdc3f7c-ecc9-4194-a36b-9065dfd9fc93 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 17e9ee44-03a4-42af-92f2-eb421df3a418] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:32.491252 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1fdc3f7c-ecc9-4194-a36b-9065dfd9fc93 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:32.491697 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1fdc3f7c-ecc9-4194-a36b-9065dfd9fc93 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:32.492452 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1fdc3f7c-ecc9-4194-a36b-9065dfd9fc93 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:32.492880 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1fdc3f7c-ecc9-4194-a36b-9065dfd9fc93 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:32.507012 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-1fdc3f7c-ecc9-4194-a36b-9065dfd9fc93 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1fdc3f7c-ecc9-4194-a36b-9065dfd9fc93 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 HTTP/1.1 Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:11:32.508677 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:32.510289 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '17e9ee44-03a4-42af-92f2-eb421df3a418'} Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:11:32.511375 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. Jun 23 16:11:32.514063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:32.517013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1fdc3f7c-ecc9-4194-a36b-9065dfd9fc93 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance 17e9ee44-03a4-42af-92f2-eb421df3a418 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:11:32.517013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1fdc3f7c-ecc9-4194-a36b-9065dfd9fc93 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418" status: 404 len: 111 microversion: 2.1 time: 0.030573 Jun 23 16:11:32.517013 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 516/1010] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:32 2022] GET /compute/v2.1/servers/17e9ee44-03a4-42af-92f2-eb421df3a418 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:11:33.673450 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1b34ce01-31c3-4289-a16c-6c1cbaec6bb6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:33.674041 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1b34ce01-31c3-4289-a16c-6c1cbaec6bb6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:33.681410 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b34ce01-31c3-4289-a16c-6c1cbaec6bb6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:33.681886 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b34ce01-31c3-4289-a16c-6c1cbaec6bb6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:33.682667 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b34ce01-31c3-4289-a16c-6c1cbaec6bb6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:33.683130 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1b34ce01-31c3-4289-a16c-6c1cbaec6bb6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:33.697762 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-1b34ce01-31c3-4289-a16c-6c1cbaec6bb6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1b34ce01-31c3-4289-a16c-6c1cbaec6bb6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 HTTP/1.1 Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:11:33.699341 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:11:33.700949 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': 'f4c3b97d-6f9a-4ce8-8081-dd5903a13761'} Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:11:33.701804 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:11:33.703378 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.704787 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1b34ce01-31c3-4289-a16c-6c1cbaec6bb6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:11:33.704787 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1b34ce01-31c3-4289-a16c-6c1cbaec6bb6 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 404 len: 111 microversion: 2.1 time: 0.031249 Jun 23 16:11:33.704787 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 495/1011] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:11:33 2022] DELETE /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:11:33.709300 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d1ad0c88-a576-466e-8563-558ba6fa0e72 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:33.710022 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-d1ad0c88-a576-466e-8563-558ba6fa0e72 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: f4c3b97d-6f9a-4ce8-8081-dd5903a13761] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:33.716687 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1ad0c88-a576-466e-8563-558ba6fa0e72 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:33.717129 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1ad0c88-a576-466e-8563-558ba6fa0e72 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:33.717891 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1ad0c88-a576-466e-8563-558ba6fa0e72 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:33.718319 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-d1ad0c88-a576-466e-8563-558ba6fa0e72 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:33.731886 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-d1ad0c88-a576-466e-8563-558ba6fa0e72 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d1ad0c88-a576-466e-8563-558ba6fa0e72 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 HTTP/1.1 Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:11:33.733435 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:11:33.735041 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': 'f4c3b97d-6f9a-4ce8-8081-dd5903a13761'} Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:11:33.735929 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. Jun 23 16:11:33.737460 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.739598 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-d1ad0c88-a576-466e-8563-558ba6fa0e72 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance f4c3b97d-6f9a-4ce8-8081-dd5903a13761 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:11:33.739598 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-d1ad0c88-a576-466e-8563-558ba6fa0e72 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761" status: 404 len: 111 microversion: 2.1 time: 0.029429 Jun 23 16:11:33.739598 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 517/1012] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:33 2022] GET /compute/v2.1/servers/f4c3b97d-6f9a-4ce8-8081-dd5903a13761 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:11:33.744000 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-218361b9-dcfc-4f97-b7e4-8c0c51f6aae4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:33.744501 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-218361b9-dcfc-4f97-b7e4-8c0c51f6aae4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:33.750639 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-218361b9-dcfc-4f97-b7e4-8c0c51f6aae4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:33.751119 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-218361b9-dcfc-4f97-b7e4-8c0c51f6aae4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:33.751881 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-218361b9-dcfc-4f97-b7e4-8c0c51f6aae4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:33.752321 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-218361b9-dcfc-4f97-b7e4-8c0c51f6aae4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:33.766627 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-218361b9-dcfc-4f97-b7e4-8c0c51f6aae4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-218361b9-dcfc-4f97-b7e4-8c0c51f6aae4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 HTTP/1.1 Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:11:33.768869 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:11:33.770504 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '47b18125-a7dc-4adf-8537-a1c18e79ccf7'} Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:11:33.771267 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:11:33.772446 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.774160 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-218361b9-dcfc-4f97-b7e4-8c0c51f6aae4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:11:33.774160 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-218361b9-dcfc-4f97-b7e4-8c0c51f6aae4 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 404 len: 111 microversion: 2.1 time: 0.029618 Jun 23 16:11:33.774160 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 496/1013] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:11:33 2022] DELETE /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:11:33.778879 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-86acc76e-51ce-4904-b3b8-965704c91a1e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:33.779473 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-86acc76e-51ce-4904-b3b8-965704c91a1e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 47b18125-a7dc-4adf-8537-a1c18e79ccf7] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:33.786155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86acc76e-51ce-4904-b3b8-965704c91a1e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:33.786605 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86acc76e-51ce-4904-b3b8-965704c91a1e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:33.787398 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86acc76e-51ce-4904-b3b8-965704c91a1e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:33.787831 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-86acc76e-51ce-4904-b3b8-965704c91a1e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:33.802283 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-86acc76e-51ce-4904-b3b8-965704c91a1e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-86acc76e-51ce-4904-b3b8-965704c91a1e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 HTTP/1.1 Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:11:33.803779 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:11:33.805339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '47b18125-a7dc-4adf-8537-a1c18e79ccf7'} Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:11:33.806167 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. Jun 23 16:11:33.807401 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:33.808544 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-86acc76e-51ce-4904-b3b8-965704c91a1e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance 47b18125-a7dc-4adf-8537-a1c18e79ccf7 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:11:33.808544 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-86acc76e-51ce-4904-b3b8-965704c91a1e tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7" status: 404 len: 111 microversion: 2.1 time: 0.030216 Jun 23 16:11:33.808544 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 518/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:33 2022] GET /compute/v2.1/servers/47b18125-a7dc-4adf-8537-a1c18e79ccf7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:11:34.945017 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dc91f4f4-05c2-44da-8f3b-e5b8db4a55c2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:34.945520 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-dc91f4f4-05c2-44da-8f3b-e5b8db4a55c2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:34.951928 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc91f4f4-05c2-44da-8f3b-e5b8db4a55c2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:34.952371 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc91f4f4-05c2-44da-8f3b-e5b8db4a55c2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:34.953121 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc91f4f4-05c2-44da-8f3b-e5b8db4a55c2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:34.953550 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-dc91f4f4-05c2-44da-8f3b-e5b8db4a55c2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:34.966614 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-dc91f4f4-05c2-44da-8f3b-e5b8db4a55c2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dc91f4f4-05c2-44da-8f3b-e5b8db4a55c2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: DELETE /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be HTTP/1.1 Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:11:34.968145 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:11:34.977068 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '0aa6e984-d2b4-48ea-b887-250c0935b0be'} Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:11:34.977842 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:11:34.979575 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:11:34.981000 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-dc91f4f4-05c2-44da-8f3b-e5b8db4a55c2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:11:34.981000 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-dc91f4f4-05c2-44da-8f3b-e5b8db4a55c2 tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 404 len: 111 microversion: 2.1 time: 0.028952 Jun 23 16:11:34.981000 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 497/1015] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:11:34 2022] DELETE /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:11:34.981260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0dd75cd9-2431-4617-998e-32d909144d3d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:34.981260 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0dd75cd9-2431-4617-998e-32d909144d3d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] [instance: 0aa6e984-d2b4-48ea-b887-250c0935b0be] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:34.985339 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0dd75cd9-2431-4617-998e-32d909144d3d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:34.985792 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0dd75cd9-2431-4617-998e-32d909144d3d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:34.986563 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0dd75cd9-2431-4617-998e-32d909144d3d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:34.987034 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0dd75cd9-2431-4617-998e-32d909144d3d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:35.001114 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-0dd75cd9-2431-4617-998e-32d909144d3d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] HTTP exception thrown: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0dd75cd9-2431-4617-998e-32d909144d3d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Request method failure captured: Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be HTTP/1.1 Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4_Bbv9Oq26DXDnehF7iEwx-IzAnQ_pQuSS0xFcuycRKN0YtgVK25TPQapb9S0LdnkUpQglOK1IPE9Li3eBEvcbSiAurpsuyqhU0qUNeaq3FiC2ln7nCyHdnhbgTuwWD4nownMdSU3leehugNQIg3I-TfnHAam8HVTLqy79VGl1q7A Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:11:35.002633 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/2063fb24abb5408794361a9032e56d3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_2063fb24abb5408794361a9032e56d3f"}]}] Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 2063fb24abb5408794361a9032e56d3f Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1461649083 Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: dac5e323b42f41859c85709a2b49623b Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeNegativeTest-1461649083-project Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:11:35.004865 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '0aa6e984-d2b4-48ea-b887-250c0935b0be'} Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:11:35.005647 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. Jun 23 16:11:35.006896 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:11:35.007996 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0dd75cd9-2431-4617-998e-32d909144d3d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] Returning 404 to user: Instance 0aa6e984-d2b4-48ea-b887-250c0935b0be could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:11:35.007996 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0dd75cd9-2431-4617-998e-32d909144d3d tempest-AttachVolumeNegativeTest-1461649083 tempest-AttachVolumeNegativeTest-1461649083-project] 10.222.0.46 "GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be" status: 404 len: 111 microversion: 2.1 time: 0.030408 Jun 23 16:11:35.007996 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 519/1016] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:11:34 2022] GET /compute/v2.1/servers/0aa6e984-d2b4-48ea-b887-250c0935b0be => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:11:39.181957 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ad869fbc-ed8b-4844-9187-5a5305db50e9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:39.182443 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ad869fbc-ed8b-4844-9187-5a5305db50e9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:39.189307 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad869fbc-ed8b-4844-9187-5a5305db50e9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:39.189698 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad869fbc-ed8b-4844-9187-5a5305db50e9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:39.190438 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad869fbc-ed8b-4844-9187-5a5305db50e9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:39.191412 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ad869fbc-ed8b-4844-9187-5a5305db50e9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:39.215596 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ad869fbc-ed8b-4844-9187-5a5305db50e9 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/ips" status: 200 len: 145 microversion: 2.1 time: 0.037435 Jun 23 16:11:39.222849 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 498/1017] 10.222.0.46 () {58 vars in 1247 bytes} [Thu Jun 23 16:11:39 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:40.564248 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ea0258e1-9910-4ea5-a5ca-1206cef21f84 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33fc2ebb-57e5-4bae-bf45-50cd9d3485e4"}} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:11:40.565305 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ea0258e1-9910-4ea5-a5ca-1206cef21f84 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:40.572558 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ea0258e1-9910-4ea5-a5ca-1206cef21f84 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:40.573010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ea0258e1-9910-4ea5-a5ca-1206cef21f84 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:40.573777 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ea0258e1-9910-4ea5-a5ca-1206cef21f84 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:40.574213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ea0258e1-9910-4ea5-a5ca-1206cef21f84 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:40.801632 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:40.811407 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ea0258e1-9910-4ea5-a5ca-1206cef21f84 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251073 Jun 23 16:11:40.812018 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 520/1018] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:11:40 2022] POST /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:48.346384 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-b91c94ea-b301-42ad-aab1-4b2729b53c93 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:48.347384 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-b91c94ea-b301-42ad-aab1-4b2729b53c93 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:48.349862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:48.355981 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b91c94ea-b301-42ad-aab1-4b2729b53c93 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:48.356438 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b91c94ea-b301-42ad-aab1-4b2729b53c93 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:48.357211 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b91c94ea-b301-42ad-aab1-4b2729b53c93 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:48.357646 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-b91c94ea-b301-42ad-aab1-4b2729b53c93 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:48.389551 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-b91c94ea-b301-42ad-aab1-4b2729b53c93 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047013 Jun 23 16:11:48.390261 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 499/1019] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:11:48 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:48.403329 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-03e5e733-d69d-4132-96f1-a342dd6ea044 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:48.403977 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-03e5e733-d69d-4132-96f1-a342dd6ea044 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:48.406080 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG dbcounter [-] [117890] Writing DB stats nova_api:SELECT=45 {{(pid=117890) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:48.411933 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-03e5e733-d69d-4132-96f1-a342dd6ea044 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:48.412458 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-03e5e733-d69d-4132-96f1-a342dd6ea044 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:48.413294 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-03e5e733-d69d-4132-96f1-a342dd6ea044 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:48.413796 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-03e5e733-d69d-4132-96f1-a342dd6ea044 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:48.443899 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-03e5e733-d69d-4132-96f1-a342dd6ea044 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments/33fc2ebb-57e5-4bae-bf45-50cd9d3485e4" status: 200 len: 194 microversion: 2.1 time: 0.046257 Jun 23 16:11:48.446732 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 521/1020] 10.222.0.46 () {58 vars in 1412 bytes} [Thu Jun 23 16:11:48 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments/33fc2ebb-57e5-4bae-bf45-50cd9d3485e4 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:49.803959 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3f3cf534-eb11-45df-9f7f-d24a9183bf95 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cea55d8b-7eeb-45f0-8a50-7dc03c95c1bb"}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:11:49.805055 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3f3cf534-eb11-45df-9f7f-d24a9183bf95 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:49.811695 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f3cf534-eb11-45df-9f7f-d24a9183bf95 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:49.812147 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f3cf534-eb11-45df-9f7f-d24a9183bf95 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:49.812911 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f3cf534-eb11-45df-9f7f-d24a9183bf95 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:49.813350 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3f3cf534-eb11-45df-9f7f-d24a9183bf95 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:50.052486 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3f3cf534-eb11-45df-9f7f-d24a9183bf95 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "POST /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253168 Jun 23 16:11:50.053084 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 500/1021] 10.222.0.46 () {60 vars in 1322 bytes} [Thu Jun 23 16:11:49 2022] POST /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:55.497743 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-693b91d1-caab-4a80-9d6a-1098b70c177f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:55.498737 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-693b91d1-caab-4a80-9d6a-1098b70c177f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:55.505832 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-693b91d1-caab-4a80-9d6a-1098b70c177f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:55.506273 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-693b91d1-caab-4a80-9d6a-1098b70c177f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:55.507063 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-693b91d1-caab-4a80-9d6a-1098b70c177f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:55.507493 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-693b91d1-caab-4a80-9d6a-1098b70c177f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:55.537757 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-693b91d1-caab-4a80-9d6a-1098b70c177f tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043869 Jun 23 16:11:55.538227 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 522/1022] 10.222.0.46 () {60 vars in 1342 bytes} [Thu Jun 23 16:11:55 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:11:55.603652 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-3b86089f-fd7f-4960-9efd-e8923685f9a1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:55.604270 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3b86089f-fd7f-4960-9efd-e8923685f9a1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:55.610466 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b86089f-fd7f-4960-9efd-e8923685f9a1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:55.610953 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b86089f-fd7f-4960-9efd-e8923685f9a1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:55.611716 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b86089f-fd7f-4960-9efd-e8923685f9a1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:55.612155 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-3b86089f-fd7f-4960-9efd-e8923685f9a1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:55.637519 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-3b86089f-fd7f-4960-9efd-e8923685f9a1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Going to try to terminate instance {{(pid=117891) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:11:55.712932 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-3b86089f-fd7f-4960-9efd-e8923685f9a1 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 204 len: 0 microversion: 2.20 time: 0.113632 Jun 23 16:11:55.713546 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 501/1023] 10.222.0.46 () {60 vars in 1279 bytes} [Thu Jun 23 16:11:55 2022] DELETE /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 16:11:55.721840 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-8a7a507c-26c7-4c44-8065-50117e44f040 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:55.722448 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-8a7a507c-26c7-4c44-8065-50117e44f040 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:55.728475 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a7a507c-26c7-4c44-8065-50117e44f040 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:55.728919 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a7a507c-26c7-4c44-8065-50117e44f040 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:55.729675 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a7a507c-26c7-4c44-8065-50117e44f040 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:55.730112 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-8a7a507c-26c7-4c44-8065-50117e44f040 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:55.864247 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8a7a507c-26c7-4c44-8065-50117e44f040 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:55.872636 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8a7a507c-26c7-4c44-8065-50117e44f040 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:55.874826 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-8a7a507c-26c7-4c44-8065-50117e44f040 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:55.876010 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-8a7a507c-26c7-4c44-8065-50117e44f040 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.158168 Jun 23 16:11:55.876640 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 523/1024] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:11:55 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:11:56.896789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-774aeb92-65a8-47ba-b3b1-eba7bb6d08e5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:56.897500 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-774aeb92-65a8-47ba-b3b1-eba7bb6d08e5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:56.904618 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-774aeb92-65a8-47ba-b3b1-eba7bb6d08e5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:56.905063 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-774aeb92-65a8-47ba-b3b1-eba7bb6d08e5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:56.905841 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-774aeb92-65a8-47ba-b3b1-eba7bb6d08e5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:56.906281 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-774aeb92-65a8-47ba-b3b1-eba7bb6d08e5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:57.055538 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-774aeb92-65a8-47ba-b3b1-eba7bb6d08e5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:57.070432 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-774aeb92-65a8-47ba-b3b1-eba7bb6d08e5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:57.073030 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-774aeb92-65a8-47ba-b3b1-eba7bb6d08e5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:57.074488 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-774aeb92-65a8-47ba-b3b1-eba7bb6d08e5 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.182565 Jun 23 16:11:57.075101 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 502/1025] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:11:56 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:11:58.093315 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f8ddb3a1-97bc-45e7-8c48-39cd16e0a95b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:58.093921 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f8ddb3a1-97bc-45e7-8c48-39cd16e0a95b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:58.101001 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f8ddb3a1-97bc-45e7-8c48-39cd16e0a95b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:58.101455 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f8ddb3a1-97bc-45e7-8c48-39cd16e0a95b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:58.102218 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f8ddb3a1-97bc-45e7-8c48-39cd16e0a95b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:58.102654 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f8ddb3a1-97bc-45e7-8c48-39cd16e0a95b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:58.234961 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f8ddb3a1-97bc-45e7-8c48-39cd16e0a95b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:58.243027 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f8ddb3a1-97bc-45e7-8c48-39cd16e0a95b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:58.244540 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-f8ddb3a1-97bc-45e7-8c48-39cd16e0a95b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:58.245703 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f8ddb3a1-97bc-45e7-8c48-39cd16e0a95b tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.156560 Jun 23 16:11:58.246256 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 524/1026] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:11:58 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:11:59.264336 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-1bfdbb69-980e-40c9-93d8-8b5ca778e1dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:59.264896 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-1bfdbb69-980e-40c9-93d8-8b5ca778e1dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:59.271577 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bfdbb69-980e-40c9-93d8-8b5ca778e1dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:59.272089 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bfdbb69-980e-40c9-93d8-8b5ca778e1dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:59.272850 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bfdbb69-980e-40c9-93d8-8b5ca778e1dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:59.273279 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-1bfdbb69-980e-40c9-93d8-8b5ca778e1dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:59.276272 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG dbcounter [-] [117891] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117891) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 16:11:59.479789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1bfdbb69-980e-40c9-93d8-8b5ca778e1dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:59.488128 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1bfdbb69-980e-40c9-93d8-8b5ca778e1dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:59.490296 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-1bfdbb69-980e-40c9-93d8-8b5ca778e1dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5dd4357556944c7089efb34ee58a8e04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7412ae4990fa4fe782cc4c5e3db00d75', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:11:59.491482 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-1bfdbb69-980e-40c9-93d8-8b5ca778e1dd tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 200 len: 1724 microversion: 2.20 time: 0.231204 Jun 23 16:11:59.492035 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 503/1027] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:11:59 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 16:11:59.684989 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-0a471711-057b-4994-a0de-4995afc5cf94 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:59.686043 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-0a471711-057b-4994-a0de-4995afc5cf94 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:59.696520 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0a471711-057b-4994-a0de-4995afc5cf94 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:59.697445 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0a471711-057b-4994-a0de-4995afc5cf94 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:59.698614 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0a471711-057b-4994-a0de-4995afc5cf94 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:59.699379 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-0a471711-057b-4994-a0de-4995afc5cf94 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:59.730330 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-0a471711-057b-4994-a0de-4995afc5cf94 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049344 Jun 23 16:11:59.730925 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 525/1028] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:11:59 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:11:59.881733 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-eae5f2c1-c93b-4324-9d92-e5b61ebebe8e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:11:59.883678 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-eae5f2c1-c93b-4324-9d92-e5b61ebebe8e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:11:59.898381 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eae5f2c1-c93b-4324-9d92-e5b61ebebe8e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:59.900089 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eae5f2c1-c93b-4324-9d92-e5b61ebebe8e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:59.901643 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eae5f2c1-c93b-4324-9d92-e5b61ebebe8e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:11:59.902815 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-eae5f2c1-c93b-4324-9d92-e5b61ebebe8e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:11:59.983714 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-eae5f2c1-c93b-4324-9d92-e5b61ebebe8e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments/33fc2ebb-57e5-4bae-bf45-50cd9d3485e4" status: 200 len: 194 microversion: 2.1 time: 0.110052 Jun 23 16:11:59.992907 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 526/1029] 10.222.0.46 () {58 vars in 1412 bytes} [Thu Jun 23 16:11:59 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments/33fc2ebb-57e5-4bae-bf45-50cd9d3485e4 => generated 194 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:12:00.004168 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-120a84ab-8dac-40ec-91cd-7598cdd5a3f2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:00.005504 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-120a84ab-8dac-40ec-91cd-7598cdd5a3f2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:00.024424 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-120a84ab-8dac-40ec-91cd-7598cdd5a3f2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:00.025518 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-120a84ab-8dac-40ec-91cd-7598cdd5a3f2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:00.026771 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-120a84ab-8dac-40ec-91cd-7598cdd5a3f2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:00.027489 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-120a84ab-8dac-40ec-91cd-7598cdd5a3f2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:00.098677 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [req-2ce35023-d65f-4a7c-ab5f-59dabb90d1b7 req-777bbfe5-a854-440f-842d-62253a823559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7563514-d6f1-44c1-b8ae-7008e842faf8", "name": "network-vif-deleted", "tag": "afe54005-6126-4438-ba09-6763f07e66d9"}]} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:12:00.107789 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2ce35023-d65f-4a7c-ab5f-59dabb90d1b7 req-777bbfe5-a854-440f-842d-62253a823559 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:00.108231 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [req-2ce35023-d65f-4a7c-ab5f-59dabb90d1b7 req-777bbfe5-a854-440f-842d-62253a823559 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:00.125744 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.compute.server_external_events [req-2ce35023-d65f-4a7c-ab5f-59dabb90d1b7 req-777bbfe5-a854-440f-842d-62253a823559 service nova] Creating event network-vif-deleted:afe54005-6126-4438-ba09-6763f07e66d9 for instance b7563514-d6f1-44c1-b8ae-7008e842faf8 on hv-cinder-83538 Jun 23 16:12:00.145052 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.objects.instance [None req-120a84ab-8dac-40ec-91cd-7598cdd5a3f2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lazy-loading 'services' on Instance uuid 81c71b24-1c7c-409e-acac-c6946af2692c {{(pid=117890) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:12:00.145835 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [req-2ce35023-d65f-4a7c-ab5f-59dabb90d1b7 req-777bbfe5-a854-440f-842d-62253a823559 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.283406 Jun 23 16:12:00.150510 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 504/1030] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:12:00.232767 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-120a84ab-8dac-40ec-91cd-7598cdd5a3f2 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "DELETE /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments/33fc2ebb-57e5-4bae-bf45-50cd9d3485e4" status: 202 len: 0 microversion: 2.1 time: 0.235091 Jun 23 16:12:00.233699 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 527/1031] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 23 16:11:59 2022] DELETE /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments/33fc2ebb-57e5-4bae-bf45-50cd9d3485e4 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:12:00.510822 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7d785b6a-c695-47f3-bdd2-995465006483 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:00.511516 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-7d785b6a-c695-47f3-bdd2-995465006483 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:00.517847 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7d785b6a-c695-47f3-bdd2-995465006483 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:00.518292 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7d785b6a-c695-47f3-bdd2-995465006483 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:00.519091 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7d785b6a-c695-47f3-bdd2-995465006483 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:00.519524 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-7d785b6a-c695-47f3-bdd2-995465006483 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:00.533143 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-7d785b6a-c695-47f3-bdd2-995465006483 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] HTTP exception thrown: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7d785b6a-c695-47f3-bdd2-995465006483 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Request method failure captured: Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 HTTP/1.1 Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4--x_cmhsaFHLh_ziPHArwz-3bTEMo3AcYa7FS05Xf8qqADj1L1Uin7HljAvGV2fJqAIMXdLiv8eFbYtH-9PNr3QLdjR_9HOduM-1PXX5ykXjbtCh9zXjTYtZWe_OIyULbQw-Kc7yYVeSp35eJLnwAIS3-vOiDtl4OKfMjRun3TWc Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:12:00.534826 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7412ae4990fa4fe782cc4c5e3db00d75"}]}] Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: 5dd4357556944c7089efb34ee58a8e04 Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:00.536390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': 'b7563514-d6f1-44c1-b8ae-7008e842faf8'} Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:12:00.537240 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:00.538536 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:00.539764 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-7d785b6a-c695-47f3-bdd2-995465006483 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Returning 404 to user: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:12:00.539764 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-7d785b6a-c695-47f3-bdd2-995465006483 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 404 len: 111 microversion: 2.20 time: 0.029734 Jun 23 16:12:00.539764 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 505/1032] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:12:00 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 16:12:00.545943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-359726b4-fe0c-4fa2-a1f4-a10a2b89d91d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '.version_select at 0x7fe28d4c5040>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:00.566130 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-359726b4-fe0c-4fa2-a1f4-a10a2b89d91d tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-861550779" status: 204 len: 0 microversion: 2.20 time: 0.024464 Jun 23 16:12:00.570952 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 528/1033] 10.222.0.46 () {60 vars in 1258 bytes} [Thu Jun 23 16:12:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-861550779 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 16:12:02.424091 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c25b6188-c397-4ed3-bc54-14f9be11b299 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:02.424738 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c25b6188-c397-4ed3-bc54-14f9be11b299 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:02.432342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c25b6188-c397-4ed3-bc54-14f9be11b299 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:02.432795 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c25b6188-c397-4ed3-bc54-14f9be11b299 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:02.433572 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c25b6188-c397-4ed3-bc54-14f9be11b299 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:02.434014 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c25b6188-c397-4ed3-bc54-14f9be11b299 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:02.436690 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5992cf60-8f66-4fa0-a9bb-3e37bd9f00c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:02.437293 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-5992cf60-8f66-4fa0-a9bb-3e37bd9f00c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:02.444037 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5992cf60-8f66-4fa0-a9bb-3e37bd9f00c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:02.444480 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5992cf60-8f66-4fa0-a9bb-3e37bd9f00c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:02.445231 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5992cf60-8f66-4fa0-a9bb-3e37bd9f00c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:02.445657 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-5992cf60-8f66-4fa0-a9bb-3e37bd9f00c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:02.458739 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-5992cf60-8f66-4fa0-a9bb-3e37bd9f00c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] HTTP exception thrown: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5992cf60-8f66-4fa0-a9bb-3e37bd9f00c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Request method failure captured: Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 HTTP/1.1 Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4--x_cmhsaFHLh_ziPHArwz-3bTEMo3AcYa7FS05Xf8qqADj1L1Uin7HljAvGV2fJqAIMXdLiv8eFbYtH-9PNr3QLdjR_9HOduM-1PXX5ykXjbtCh9zXjTYtZWe_OIyULbQw-Kc7yYVeSp35eJLnwAIS3-vOiDtl4OKfMjRun3TWc Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:12:02.460496 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7412ae4990fa4fe782cc4c5e3db00d75"}]}] Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: 5dd4357556944c7089efb34ee58a8e04 Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:02.462155 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': 'b7563514-d6f1-44c1-b8ae-7008e842faf8'} Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:12:02.463093 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:02.464370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:02.466270 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-5992cf60-8f66-4fa0-a9bb-3e37bd9f00c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Returning 404 to user: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:12:02.466270 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-5992cf60-8f66-4fa0-a9bb-3e37bd9f00c7 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 404 len: 111 microversion: 2.20 time: 0.029595 Jun 23 16:12:02.466270 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 529/1034] 10.222.0.46 () {60 vars in 1279 bytes} [Thu Jun 23 16:12:02 2022] DELETE /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 23 16:12:02.467979 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c25b6188-c397-4ed3-bc54-14f9be11b299 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments/cea55d8b-7eeb-45f0-8a50-7dc03c95c1bb" status: 200 len: 194 microversion: 2.1 time: 0.047969 Jun 23 16:12:02.468693 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 506/1035] 10.222.0.46 () {58 vars in 1412 bytes} [Thu Jun 23 16:12:02 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments/cea55d8b-7eeb-45f0-8a50-7dc03c95c1bb => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:12:02.474507 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4bb56322-da8e-43ab-b8bf-a18968bfb3cb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:02.475703 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-4bb56322-da8e-43ab-b8bf-a18968bfb3cb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: b7563514-d6f1-44c1-b8ae-7008e842faf8] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:02.478169 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c5e4c6d7-7181-473c-afa4-7fe759953050 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:02.478667 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c5e4c6d7-7181-473c-afa4-7fe759953050 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:02.482075 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4bb56322-da8e-43ab-b8bf-a18968bfb3cb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:02.482518 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4bb56322-da8e-43ab-b8bf-a18968bfb3cb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:02.483359 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4bb56322-da8e-43ab-b8bf-a18968bfb3cb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:02.483792 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-4bb56322-da8e-43ab-b8bf-a18968bfb3cb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:02.484544 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c5e4c6d7-7181-473c-afa4-7fe759953050 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:02.484994 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c5e4c6d7-7181-473c-afa4-7fe759953050 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:02.485763 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c5e4c6d7-7181-473c-afa4-7fe759953050 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:02.486202 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c5e4c6d7-7181-473c-afa4-7fe759953050 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:02.497789 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-4bb56322-da8e-43ab-b8bf-a18968bfb3cb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] HTTP exception thrown: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4bb56322-da8e-43ab-b8bf-a18968bfb3cb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Request method failure captured: Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 HTTP/1.1 Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4--x_cmhsaFHLh_ziPHArwz-3bTEMo3AcYa7FS05Xf8qqADj1L1Uin7HljAvGV2fJqAIMXdLiv8eFbYtH-9PNr3QLdjR_9HOduM-1PXX5ykXjbtCh9zXjTYtZWe_OIyULbQw-Kc7yYVeSp35eJLnwAIS3-vOiDtl4OKfMjRun3TWc Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:12:02.499351 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7412ae4990fa4fe782cc4c5e3db00d75"}]}] Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: 5dd4357556944c7089efb34ee58a8e04 Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:02.500971 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': 'b7563514-d6f1-44c1-b8ae-7008e842faf8'} Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:12:02.502060 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. Jun 23 16:12:02.503560 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:02.505609 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-4bb56322-da8e-43ab-b8bf-a18968bfb3cb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Returning 404 to user: Instance b7563514-d6f1-44c1-b8ae-7008e842faf8 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:12:02.505609 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-4bb56322-da8e-43ab-b8bf-a18968bfb3cb tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8" status: 404 len: 111 microversion: 2.20 time: 0.034286 Jun 23 16:12:02.505609 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 530/1036] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:12:02 2022] GET /compute/v2.1/servers/b7563514-d6f1-44c1-b8ae-7008e842faf8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 23 16:12:02.579165 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.objects.instance [None req-c5e4c6d7-7181-473c-afa4-7fe759953050 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lazy-loading 'services' on Instance uuid 81c71b24-1c7c-409e-acac-c6946af2692c {{(pid=117891) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 16:12:02.654152 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c5e4c6d7-7181-473c-afa4-7fe759953050 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "DELETE /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments/cea55d8b-7eeb-45f0-8a50-7dc03c95c1bb" status: 202 len: 0 microversion: 2.1 time: 0.179976 Jun 23 16:12:02.655018 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 507/1037] 10.222.0.46 () {58 vars in 1415 bytes} [Thu Jun 23 16:12:02 2022] DELETE /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments/cea55d8b-7eeb-45f0-8a50-7dc03c95c1bb => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 16:12:03.652602 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f6be32f7-c30d-4e0f-afe1-fe1fd2b901f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:03.653140 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-f6be32f7-c30d-4e0f-afe1-fe1fd2b901f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:03.659659 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6be32f7-c30d-4e0f-afe1-fe1fd2b901f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:03.660112 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6be32f7-c30d-4e0f-afe1-fe1fd2b901f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:03.660877 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6be32f7-c30d-4e0f-afe1-fe1fd2b901f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:03.661317 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-f6be32f7-c30d-4e0f-afe1-fe1fd2b901f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:03.674527 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.wsgi [None req-f6be32f7-c30d-4e0f-afe1-fe1fd2b901f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] HTTP exception thrown: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f6be32f7-c30d-4e0f-afe1-fe1fd2b901f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Request method failure captured: Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: request: DELETE /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 HTTP/1.1 Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept: application/json Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Accept-Encoding: identity Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Connection: close Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Length: 0 Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Content-Type: application/json Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Host: 10.222.0.46 Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Openstack-System-Scope: None Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: User-Agent: python-urllib3/1.26.9 Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Auth-Token: gAAAAABitI4--x_cmhsaFHLh_ziPHArwz-3bTEMo3AcYa7FS05Xf8qqADj1L1Uin7HljAvGV2fJqAIMXdLiv8eFbYtH-9PNr3QLdjR_9HOduM-1PXX5ykXjbtCh9zXjTYtZWe_OIyULbQw-Kc7yYVeSp35eJLnwAIS3-vOiDtl4OKfMjRun3TWc Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Id: None Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Domain-Name: None Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Identity-Status: Confirmed Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Is-Admin-Project: True Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Id: default Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Domain-Name: Default Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Role: reader,member Jun 23 16:12:03.676101 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Roles: reader,member Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7412ae4990fa4fe782cc4c5e3db00d75"}]}] Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Id: default Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Domain-Name: Default Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Id: 5dd4357556944c7089efb34ee58a8e04 Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: X-User-Name: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: method: > Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: exception: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:12:03.677776 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: action_args: {'id': '14021a2e-8af8-4292-996e-ea87ff7752e0'} Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:12:03.679135 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:12:03.680344 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: ERROR nova.api.openstack.wsgi Jun 23 16:12:03.681610 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f6be32f7-c30d-4e0f-afe1-fe1fd2b901f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Returning 404 to user: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. {{(pid=117890) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:12:03.681610 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f6be32f7-c30d-4e0f-afe1-fe1fd2b901f6 tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "DELETE /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 404 len: 111 microversion: 2.20 time: 0.029154 Jun 23 16:12:03.681610 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 531/1038] 10.222.0.46 () {60 vars in 1279 bytes} [Thu Jun 23 16:12:03 2022] DELETE /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 16:12:03.687023 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ea197b95-9a11-4c2d-9914-4ccc4373bb0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:03.687719 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-ea197b95-9a11-4c2d-9914-4ccc4373bb0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] [instance: 14021a2e-8af8-4292-996e-ea87ff7752e0] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:03.695044 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ea197b95-9a11-4c2d-9914-4ccc4373bb0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:03.695491 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ea197b95-9a11-4c2d-9914-4ccc4373bb0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:03.696257 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ea197b95-9a11-4c2d-9914-4ccc4373bb0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:03.696688 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-ea197b95-9a11-4c2d-9914-4ccc4373bb0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:03.712209 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-ea197b95-9a11-4c2d-9914-4ccc4373bb0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] HTTP exception thrown: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ea197b95-9a11-4c2d-9914-4ccc4373bb0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Request method failure captured: Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 HTTP/1.1 Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI4--x_cmhsaFHLh_ziPHArwz-3bTEMo3AcYa7FS05Xf8qqADj1L1Uin7HljAvGV2fJqAIMXdLiv8eFbYtH-9PNr3QLdjR_9HOduM-1PXX5ykXjbtCh9zXjTYtZWe_OIyULbQw-Kc7yYVeSp35eJLnwAIS3-vOiDtl4OKfMjRun3TWc Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:12:03.714246 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7412ae4990fa4fe782cc4c5e3db00d75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7412ae4990fa4fe782cc4c5e3db00d75"}]}] Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 7412ae4990fa4fe782cc4c5e3db00d75 Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-100177245 Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: 5dd4357556944c7089efb34ee58a8e04 Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeShelveTestJSON-100177245-project Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:12:03.715702 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '14021a2e-8af8-4292-996e-ea87ff7752e0'} Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:12:03.716437 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. Jun 23 16:12:03.717733 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:03.719071 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-ea197b95-9a11-4c2d-9914-4ccc4373bb0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] Returning 404 to user: Instance 14021a2e-8af8-4292-996e-ea87ff7752e0 could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:12:03.719071 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-ea197b95-9a11-4c2d-9914-4ccc4373bb0c tempest-AttachVolumeShelveTestJSON-100177245 tempest-AttachVolumeShelveTestJSON-100177245-project] 10.222.0.46 "GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0" status: 404 len: 111 microversion: 2.20 time: 0.032880 Jun 23 16:12:03.719071 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 508/1039] 10.222.0.46 () {60 vars in 1276 bytes} [Thu Jun 23 16:12:03 2022] GET /compute/v2.1/servers/14021a2e-8af8-4292-996e-ea87ff7752e0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 16:12:03.822213 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1bebcfe0-a1a3-4b58-84f4-1a7c43287864 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:03.823291 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-1bebcfe0-a1a3-4b58-84f4-1a7c43287864 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:03.831543 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1bebcfe0-a1a3-4b58-84f4-1a7c43287864 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:03.835951 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1bebcfe0-a1a3-4b58-84f4-1a7c43287864 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:03.840949 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1bebcfe0-a1a3-4b58-84f4-1a7c43287864 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:03.842797 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-1bebcfe0-a1a3-4b58-84f4-1a7c43287864 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:03.888370 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1bebcfe0-a1a3-4b58-84f4-1a7c43287864 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071982 Jun 23 16:12:03.888946 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 532/1040] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:12:03 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 16:12:04.001061 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-37caff66-468b-45ec-af88-8dedd7046e23 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:04.001987 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-37caff66-468b-45ec-af88-8dedd7046e23 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:04.007905 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-37caff66-468b-45ec-af88-8dedd7046e23 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:04.008354 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-37caff66-468b-45ec-af88-8dedd7046e23 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:04.009112 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-37caff66-468b-45ec-af88-8dedd7046e23 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:04.009541 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-37caff66-468b-45ec-af88-8dedd7046e23 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:04.038219 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-37caff66-468b-45ec-af88-8dedd7046e23 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040511 Jun 23 16:12:04.039233 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 509/1041] 10.222.0.46 () {58 vars in 1301 bytes} [Thu Jun 23 16:12:03 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 16:12:04.096762 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-ed38a70d-bf4f-4c28-8a4e-b57ee1560d9a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:04.097264 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ed38a70d-bf4f-4c28-8a4e-b57ee1560d9a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:04.103750 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed38a70d-bf4f-4c28-8a4e-b57ee1560d9a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:04.104200 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed38a70d-bf4f-4c28-8a4e-b57ee1560d9a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:04.104965 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed38a70d-bf4f-4c28-8a4e-b57ee1560d9a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:04.105403 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-ed38a70d-bf4f-4c28-8a4e-b57ee1560d9a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:04.134194 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-ed38a70d-bf4f-4c28-8a4e-b57ee1560d9a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Going to try to terminate instance {{(pid=117890) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 16:12:04.213308 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-ed38a70d-bf4f-4c28-8a4e-b57ee1560d9a tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "DELETE /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 204 len: 0 microversion: 2.1 time: 0.120012 Jun 23 16:12:04.214152 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 533/1042] 10.222.0.46 () {58 vars in 1238 bytes} [Thu Jun 23 16:12:04 2022] DELETE /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 16:12:04.223197 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-c38f0565-3fbb-4c0f-9873-25035f74876c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:04.223802 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-c38f0565-3fbb-4c0f-9873-25035f74876c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:04.230762 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c38f0565-3fbb-4c0f-9873-25035f74876c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:04.231252 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c38f0565-3fbb-4c0f-9873-25035f74876c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:04.232033 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c38f0565-3fbb-4c0f-9873-25035f74876c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:04.232469 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-c38f0565-3fbb-4c0f-9873-25035f74876c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:04.725179 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-c38f0565-3fbb-4c0f-9873-25035f74876c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:12:04.732662 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-c38f0565-3fbb-4c0f-9873-25035f74876c tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1672 microversion: 2.1 time: 0.513286 Jun 23 16:12:04.733226 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 510/1043] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:12:04 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1672 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:12:05.750221 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-be7d28c0-b0a8-4eb8-839c-cc2f34c5cbe7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:05.750973 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.compute.api [None req-be7d28c0-b0a8-4eb8-839c-cc2f34c5cbe7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117890) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:05.757551 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be7d28c0-b0a8-4eb8-839c-cc2f34c5cbe7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:05.758079 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be7d28c0-b0a8-4eb8-839c-cc2f34c5cbe7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:05.758974 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be7d28c0-b0a8-4eb8-839c-cc2f34c5cbe7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:05.759504 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [None req-be7d28c0-b0a8-4eb8-839c-cc2f34c5cbe7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:05.899142 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.policy [None req-be7d28c0-b0a8-4eb8-839c-cc2f34c5cbe7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117890) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:12:05.907572 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-be7d28c0-b0a8-4eb8-839c-cc2f34c5cbe7 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1672 microversion: 2.1 time: 0.161656 Jun 23 16:12:05.908160 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 534/1044] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:12:05 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 16:12:06.926756 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-8d2b4096-e92b-4b34-af07-e0ceabc48d7b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:06.927372 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-8d2b4096-e92b-4b34-af07-e0ceabc48d7b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:06.940224 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d2b4096-e92b-4b34-af07-e0ceabc48d7b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:06.940751 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d2b4096-e92b-4b34-af07-e0ceabc48d7b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:06.942846 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d2b4096-e92b-4b34-af07-e0ceabc48d7b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:06.944541 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-8d2b4096-e92b-4b34-af07-e0ceabc48d7b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:07.392931 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.policy [None req-8d2b4096-e92b-4b34-af07-e0ceabc48d7b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b423368e84084ac89334f13b723c6b31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e09ed68cdf94f5a83ae9581419aa876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117891) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 16:12:07.403383 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-8d2b4096-e92b-4b34-af07-e0ceabc48d7b tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 200 len: 1672 microversion: 2.1 time: 0.480567 Jun 23 16:12:07.404761 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 511/1045] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:12:06 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 1672 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 16:12:07.681254 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [req-0c6796cf-388c-4d70-9a01-1e80c0b9bb92 req-78d70cca-0dd4-413e-a2f7-ee8096d0d7e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81c71b24-1c7c-409e-acac-c6946af2692c", "name": "network-vif-deleted", "tag": "09f5835c-4231-4c60-92b4-d34edd7b9267"}]} {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:12:07.699627 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-0c6796cf-388c-4d70-9a01-1e80c0b9bb92 req-78d70cca-0dd4-413e-a2f7-ee8096d0d7e2 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:07.700235 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG oslo_concurrency.lockutils [req-0c6796cf-388c-4d70-9a01-1e80c0b9bb92 req-78d70cca-0dd4-413e-a2f7-ee8096d0d7e2 service nova] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117890) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:07.723817 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.compute.server_external_events [req-0c6796cf-388c-4d70-9a01-1e80c0b9bb92 req-78d70cca-0dd4-413e-a2f7-ee8096d0d7e2 service nova] Creating event network-vif-deleted:09f5835c-4231-4c60-92b4-d34edd7b9267 for instance 81c71b24-1c7c-409e-acac-c6946af2692c on hv-cinder-83538 Jun 23 16:12:07.729265 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [req-0c6796cf-388c-4d70-9a01-1e80c0b9bb92 req-78d70cca-0dd4-413e-a2f7-ee8096d0d7e2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052279 Jun 23 16:12:07.730185 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 535/1046] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jun 23 16:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 16:12:08.422773 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a59386d9-7ba4-4613-bdca-e47d5cb99d89 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '>' {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:08.423342 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.compute.api [None req-a59386d9-7ba4-4613-bdca-e47d5cb99d89 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] [instance: 81c71b24-1c7c-409e-acac-c6946af2692c] Fetching instance by UUID {{(pid=117891) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 16:12:08.430750 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a59386d9-7ba4-4613-bdca-e47d5cb99d89 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:08.431381 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a59386d9-7ba4-4613-bdca-e47d5cb99d89 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:08.432336 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a59386d9-7ba4-4613-bdca-e47d5cb99d89 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 16:12:08.432768 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG oslo_concurrency.lockutils [None req-a59386d9-7ba4-4613-bdca-e47d5cb99d89 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Lock "7b684caf-4cee-45d0-96c0-d4ffe1988b04" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117891) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 16:12:08.447472 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.wsgi [None req-a59386d9-7ba4-4613-bdca-e47d5cb99d89 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] HTTP exception thrown: Instance 81c71b24-1c7c-409e-acac-c6946af2692c could not be found. Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a59386d9-7ba4-4613-bdca-e47d5cb99d89 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Request method failure captured: Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: request: GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c HTTP/1.1 Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept: application/json Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Accept-Encoding: identity Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Connection: close Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Length: 0 Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Content-Type: application/json Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Host: 10.222.0.46 Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Openstack-System-Scope: None Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: User-Agent: python-urllib3/1.26.9 Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Auth-Token: gAAAAABitI7CmvIfI4wkHIl6kJo84ScnQd4GhXA8g_s1I3F5jlC--572KPkrL3HT0vjg-aEGd0BSqe1YBuOc6ypAz21rJBLh4Ns-E3CBDDmJnqMnS-EO9ORR4CBcS_OhvhN_xblSqz8-HS6nWWMpnyBa8vAzPXUcnxoVE8nxAD89zRk1zx4fZgE Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Id: None Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Domain-Name: None Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Identity-Status: Confirmed Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Is-Admin-Project: True Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Id: default Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Domain-Name: Default Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Id: 3e09ed68cdf94f5a83ae9581419aa876 Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Project-Name: tempest-AttachVolumeTestJSON-416645996 Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Role: reader,member Jun 23 16:12:08.449862 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Roles: reader,member Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e09ed68cdf94f5a83ae9581419aa876"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3e09ed68cdf94f5a83ae9581419aa876"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e09ed68cdf94f5a83ae9581419aa876"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.46:8080", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3e09ed68cdf94f5a83ae9581419aa876"}]}] Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant: tempest-AttachVolumeTestJSON-416645996 Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Id: 3e09ed68cdf94f5a83ae9581419aa876 Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-Tenant-Name: tempest-AttachVolumeTestJSON-416645996 Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User: tempest-AttachVolumeTestJSON-416645996-project Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Id: default Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Domain-Name: Default Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Id: b423368e84084ac89334f13b723c6b31 Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: X-User-Name: tempest-AttachVolumeTestJSON-416645996-project Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: method: > Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: exception: Instance 81c71b24-1c7c-409e-acac-c6946af2692c could not be found. Jun 23 16:12:08.452407 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: action_args: {'id': '81c71b24-1c7c-409e-acac-c6946af2692c'} Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81c71b24-1c7c-409e-acac-c6946af2692c could not be found. Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 16:12:08.453159 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81c71b24-1c7c-409e-acac-c6946af2692c could not be found. Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81c71b24-1c7c-409e-acac-c6946af2692c could not be found. Jun 23 16:12:08.454390 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: ERROR nova.api.openstack.wsgi Jun 23 16:12:08.455635 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-a59386d9-7ba4-4613-bdca-e47d5cb99d89 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Returning 404 to user: Instance 81c71b24-1c7c-409e-acac-c6946af2692c could not be found. {{(pid=117891) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 16:12:08.455635 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-a59386d9-7ba4-4613-bdca-e47d5cb99d89 tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c" status: 404 len: 111 microversion: 2.1 time: 0.032449 Jun 23 16:12:08.455635 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 512/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Thu Jun 23 16:12:08 2022] GET /compute/v2.1/servers/81c71b24-1c7c-409e-acac-c6946af2692c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 16:12:08.461425 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-f5f8877c-af44-4eb1-a8b7-0ce7b87d622e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] Calling method '.version_select at 0x7fe28d3f7040>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:08.480772 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-f5f8877c-af44-4eb1-a8b7-0ce7b87d622e tempest-AttachVolumeTestJSON-416645996 tempest-AttachVolumeTestJSON-416645996-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1347771122" status: 202 len: 0 microversion: 2.1 time: 0.024131 Jun 23 16:12:08.481357 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 536/1048] 10.222.0.46 () {58 vars in 1220 bytes} [Thu Jun 23 16:12:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1347771122 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 16:12:08.638457 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: DEBUG nova.api.openstack.wsgi [None req-56babfd4-bbd5-4bd5-b48f-35cf69ef369d tempest-VolumesGetTestJSON-466354778 tempest-VolumesGetTestJSON-466354778-project] Action: 'create', calling method: .version_select at 0x7fe28d4d7e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-40794981", "metadata": {"Type": "work"}}} {{(pid=117891) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 16:12:08.984793 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO nova.api.openstack.requestlog [None req-56babfd4-bbd5-4bd5-b48f-35cf69ef369d tempest-VolumesGetTestJSON-466354778 tempest-VolumesGetTestJSON-466354778-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 0.483692 Jun 23 16:12:08.992669 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: [pid: 117891|app: 0|req: 513/1049] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Jun 23 16:12:08 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 492 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 16:12:08.997194 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: DEBUG nova.api.openstack.wsgi [None req-1fc1cc97-3888-4eef-b667-337c43aff26a tempest-VolumesGetTestJSON-466354778 tempest-VolumesGetTestJSON-466354778-project] Calling method '.version_select at 0x7fe28d44e550>' {{(pid=117890) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 16:12:09.049493 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO nova.api.openstack.requestlog [None req-1fc1cc97-3888-4eef-b667-337c43aff26a tempest-VolumesGetTestJSON-466354778 tempest-VolumesGetTestJSON-466354778-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/70cf8ddd-100c-4389-ad1f-92784e223567" status: 200 len: 351 microversion: 2.1 time: 0.056160 Jun 23 16:12:09.050087 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: [pid: 117890|app: 0|req: 537/1050] 10.222.0.46 () {58 vars in 1244 bytes} [Thu Jun 23 16:12:08 2022] GET /compute/v2.1/os-volumes/70cf8ddd-100c-4389-ad1f-92784e223567 => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 16:14:26.182383 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 16:14:26.183019 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Thu Jun 23 16:14:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 16:14:42.737737 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 16:14:42.738457 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Thu Jun 23 16:14:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 16:14:45.513866 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 16:14:45.514454 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Thu Jun 23 16:14:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 16:15:55.148194 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 16:15:55.148943 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Thu Jun 23 16:15:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 16:16:35.033395 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 16:16:35.033897 dv-cinder-835384-9-iscsi devstack@n-api.service[117891]: Thu Jun 23 16:16:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 16:17:42.810389 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 16:17:42.810941 dv-cinder-835384-9-iscsi devstack@n-api.service[117890]: Thu Jun 23 16:17:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!